-- Logs begin at Sat 2022-06-04 08:25:58 UTC, end at Sat 2022-06-04 09:51:15 UTC. -- Jun 04 09:16:24.376092 dv-cinder-844695-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 09:16:24.386930 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 09:16:24 2022] *** Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: nodename: dv-cinder-844695-1-iscsi Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: machine: x86_64 Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: clock source: unix Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: pcre jit disabled Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: detected number of CPU cores: 4 Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: current working directory: / Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: detected binary path: /usr/bin/uwsgi-core Jun 04 09:16:24.388136 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: your processes number limit is 47680 Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: your memory page size is 4096 bytes Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: detected max file descriptor number: 2048 Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: lock engine: pthread robust mutexes Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: thunder lock: enabled Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 09:16:24.388870 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 09:16:24.434663 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: Python main interpreter initialized at 0x55c85553c9c0 Jun 04 09:16:24.434663 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: python threads support enabled Jun 04 09:16:24.434663 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: your server socket listen backlog is limited to 100 connections Jun 04 09:16:24.434663 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: your mercy for graceful operations on workers is 90 seconds Jun 04 09:16:24.435188 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 09:16:24.435188 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: *** Operational MODE: preforking *** Jun 04 09:16:24.435392 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: *** uWSGI is running in multiple interpreter mode *** Jun 04 09:16:24.435392 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: spawned uWSGI master process (pid: 103824) Jun 04 09:16:24.435677 dv-cinder-844695-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 04 09:16:24.436385 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: spawned uWSGI worker 1 (pid: 103825, cores: 1) Jun 04 09:16:24.437402 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: spawned uWSGI worker 2 (pid: 103826, cores: 1) Jun 04 09:16:24.437402 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 09:16:25.709022 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 09:16:25.768122 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 09:16:26.453636 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:16:26.453636 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: from cryptography.utils import int_from_bytes Jun 04 09:16:26.454018 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:16:26.454018 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: from cryptography.utils import int_from_bytes Jun 04 09:16:26.485390 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:16:26.485390 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: from cryptography.utils import int_from_bytes Jun 04 09:16:26.485779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:16:26.485779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: from cryptography.utils import int_from_bytes Jun 04 09:16:29.119792 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 09:16:29.120700 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 09:16:29.120700 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 09:16:29.120992 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 09:16:29.121208 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 09:16:29.121364 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 09:16:29.121984 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.122144 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 09:16:29.122299 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.122444 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 09:16:29.122602 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.122738 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 09:16:29.122882 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123024 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 09:16:29.123157 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123282 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123409 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123551 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123677 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123801 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.123966 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124091 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124382 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124382 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124624 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124763 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.124892 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125031 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844695-1-iscsi {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125183 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125329 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125411 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125640 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125879 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.125978 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126189 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126329 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126471 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126628 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126776 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844695-1-iscsi {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.126930 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127066 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127212 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127377 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127473 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127559 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.127995 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128150 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128340 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128470 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128588 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128708 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128815 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.128951 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129145 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129327 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129520 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129699 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129846 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.129975 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130109 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130211 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130422 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130566 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130770 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.130921 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.131110 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.131270 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844695-1-iscsi {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.131479 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.131629 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.131839 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.132046 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.132259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.132470 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.132675 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.132887 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.133100 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844695-1-iscsi {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.133251 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.133453 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.133599 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.133824 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134023 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134154 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134355 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134355 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134721 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.134886 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135029 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135164 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135307 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135445 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135607 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.135759 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136196 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136360 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136491 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136715 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.136863 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137017 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137160 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137321 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137464 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137626 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137777 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.137934 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138078 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138217 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138378 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138522 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138650 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138775 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.138930 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139076 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139233 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139390 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139531 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139681 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139835 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.139997 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140143 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140370 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140535 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140677 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140818 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.140986 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141142 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141353 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141500 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141656 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141817 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.141961 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142114 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142271 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142471 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142622 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142785 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.142992 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143154 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143368 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143533 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143677 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143833 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.143982 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.144147 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.144577 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.144793 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.144946 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.145606 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.145756 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.145756 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146039 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146039 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146317 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146464 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146611 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146751 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.146897 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147038 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147205 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147351 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147492 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147651 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147802 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.147957 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148087 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148224 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148421 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148567 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.148885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149040 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149183 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149327 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149484 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149634 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149796 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.149938 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150079 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150222 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150389 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150537 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150691 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150833 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.150973 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151114 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151257 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151404 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151663 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151807 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.151954 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152093 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152229 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152432 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152654 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152808 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.152951 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.153149 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.153309 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.153513 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.153670 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.153874 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154021 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154175 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154317 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154534 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154691 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154846 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.154970 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155122 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155264 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155418 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155577 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155733 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.155867 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156002 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156140 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156346 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156493 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156632 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156775 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.156940 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157083 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157238 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157393 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157543 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157703 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157848 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.157989 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158151 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158292 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158428 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158580 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158718 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.158864 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159030 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159173 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159314 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159455 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159607 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159706 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159859 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.159953 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160102 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160234 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160359 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160460 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160543 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.160672 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.161379 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.161523 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.161666 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.161816 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.161953 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162092 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162243 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162382 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162526 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162690 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.162887 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163032 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163173 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163384 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163533 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163749 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.163953 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164101 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164245 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164469 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164612 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164768 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.164907 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165089 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165277 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165425 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165587 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165731 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.165891 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.166034 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.166179 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.166310 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.166455 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.166590 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.166725 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.166875 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.167016 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.167161 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.167312 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.167469 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.167613 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:16:29.167753 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.167893 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168059 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168200 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168364 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168508 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168628 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168700 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168780 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168857 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.168939 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169006 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169077 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169144 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169235 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169304 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169385 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169487 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169627 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169771 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.169933 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170074 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170227 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170384 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170563 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170715 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.170891 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171034 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171178 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171321 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171464 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171618 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.171874 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172020 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172173 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172342 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172500 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172656 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172794 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.172930 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173051 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173172 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173296 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173440 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173773 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.173956 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174108 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174254 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174405 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174552 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174709 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.174856 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175001 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175145 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175312 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175441 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175574 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175720 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.175867 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176023 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176176 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176465 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176634 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176780 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.176926 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177082 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177226 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177380 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177525 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177670 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177811 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.177970 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178124 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178266 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178404 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178633 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178777 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.178929 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179068 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179209 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179354 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179510 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179657 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179814 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.179958 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180278 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180518 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180680 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180819 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.180970 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181115 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181274 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181420 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181573 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181717 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181856 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.181982 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182125 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182264 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182415 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182558 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182693 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182830 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.182976 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183116 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183399 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183528 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183672 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183811 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.183959 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.184084 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.184208 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.184764 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.184984 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.185172 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.185373 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.185528 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.185723 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.185884 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186030 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186175 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186338 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186483 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186625 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186765 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.186908 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187051 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187215 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187365 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187509 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187666 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187817 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.187973 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188123 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188265 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188431 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188573 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188720 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.188883 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189030 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189175 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189314 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189512 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189707 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.189913 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190096 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190244 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190387 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190537 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190689 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190846 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.190991 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191131 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191287 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191435 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191591 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191737 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.191880 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192059 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192202 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192369 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192534 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192694 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192851 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.192997 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193143 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193286 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193497 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193647 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193791 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.193932 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194308 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194471 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194629 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194771 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.194899 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195022 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195181 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195315 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195454 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195597 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195746 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.195885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196027 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196168 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196477 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196615 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196772 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.196927 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197084 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197222 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197367 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197509 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197661 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197808 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.197969 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198125 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198279 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198424 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198574 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198739 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.198877 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199010 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199137 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199267 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199405 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199557 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199693 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199827 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.199979 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200125 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200256 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200540 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200698 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200851 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.200994 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201240 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201371 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201488 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201610 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.201875 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202029 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202192 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202332 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202470 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202621 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202763 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.202906 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203039 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203169 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203315 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203453 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203593 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203733 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.203873 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204018 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204167 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204394 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204599 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204758 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.204965 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205123 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205271 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205424 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.205877 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206023 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206170 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206301 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206459 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206623 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206768 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.206913 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.207071 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.207216 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.207373 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.207529 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208208 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208448 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208592 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208732 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208896 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.208896 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209164 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209315 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209456 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209597 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209752 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.209896 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210040 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210195 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210335 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210491 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210638 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210787 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.210980 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211269 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211432 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211572 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211708 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211844 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.211985 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212121 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212280 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212456 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212662 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212807 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.212973 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213112 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213263 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213413 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213554 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213694 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.213894 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214041 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214169 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214300 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214489 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214674 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214824 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.214989 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215172 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215312 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215461 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215607 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215765 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.215931 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216077 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216258 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216472 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216596 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216719 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216865 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.216997 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217130 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217269 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217410 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217540 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217678 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217799 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.217925 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218053 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218170 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218296 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218425 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218561 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218697 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218826 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.218958 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219112 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219264 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219408 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219547 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219688 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219812 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.219953 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220094 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220246 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220421 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220587 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220727 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.220883 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221065 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221206 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221338 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221471 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221630 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221758 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.221900 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222043 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222180 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222350 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222501 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222665 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222812 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.222987 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.223133 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.223361 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.224074 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.224266 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.224510 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.224705 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.224911 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.225101 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.225297 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.225510 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.225713 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.225914 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226105 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226354 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226549 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226752 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226947 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.226947 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.227339 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.227545 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.227738 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.227928 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.228127 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.228363 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.228576 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.228788 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.228989 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.229193 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.229405 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.229618 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.229831 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.230028 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.230239 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.230436 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.230625 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.230827 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.231039 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.231230 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.231445 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.231643 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.231857 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.232048 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.232239 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.232239 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.232750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.232943 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.233144 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.233354 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.233572 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.233781 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.233971 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.234182 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.234371 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.234577 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.234782 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.234982 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.235170 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.235362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.235557 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.235758 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.235960 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.236162 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.236391 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.236580 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.236761 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.236966 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.237162 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.237359 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.237572 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.237772 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.237968 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.238194 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.238405 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.238617 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.238867 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.239063 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.239248 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.239443 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.239638 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.239857 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.240070 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.240271 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.240595 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.240794 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.241017 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.241017 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.241413 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.241671 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.241875 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.242077 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.242279 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.242494 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.242691 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.242882 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.243082 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.243082 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.243461 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.243673 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.243883 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.244085 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.244325 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.244538 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.244753 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.244954 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.245166 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.245369 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.245561 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.245739 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.245949 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.246148 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.246348 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.246550 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.246749 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.246930 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.247155 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.247352 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.247551 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.247739 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.247929 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.248143 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.248426 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.248627 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.248826 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.249022 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.249223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.249440 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.249638 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.249833 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.250031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.250238 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.250441 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.250709 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.250919 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.251127 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.251338 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.251534 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.251951 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.252139 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.252393 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.252612 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.252819 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.253036 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.253242 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.253446 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.253646 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.253907 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.254099 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.254306 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.254539 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.254735 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.254934 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.255137 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.255337 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.255548 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.255759 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.255963 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.256174 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.256387 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.256608 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.256831 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.257014 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.257218 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.257413 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.257737 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.257942 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.258153 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.258354 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.258555 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.258753 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.258930 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.259131 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.259335 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.259533 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.259748 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.259948 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.260160 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.260400 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.260598 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.260797 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.260991 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.261193 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.261402 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.261618 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.261818 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.262014 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.262209 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.262399 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.262702 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.262904 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.263094 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.263292 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.263489 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.263685 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.263889 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.264099 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.264357 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.264578 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.264771 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.264969 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.265167 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.265362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.265543 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.265712 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.265895 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.266066 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.266265 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.266450 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.266642 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.266823 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267006 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267213 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267395 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267568 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267755 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.267934 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.268125 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.268369 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.268554 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.268735 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.268909 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.269085 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.269521 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.269724 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.269906 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.270621 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.270820 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271006 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271190 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271391 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271584 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271771 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.271958 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.272145 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.272361 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.272566 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.272745 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.272926 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.273095 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.273280 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.273474 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.273652 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.274778 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.274986 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.275183 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.275392 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.275564 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.275735 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.275926 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.276117 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.276443 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.276671 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.276880 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.277088 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.277295 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.277498 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.277708 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.277914 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.278111 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.278312 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.278513 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.278706 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.278897 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.279102 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.279296 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.279493 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.279692 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.279891 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.280107 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.280427 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.280630 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.280829 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.281029 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.281229 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.281462 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.281669 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.281873 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.282088 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.282290 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.282491 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.282705 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.282924 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.283123 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.283326 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.283529 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.283733 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.283955 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.284161 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.284386 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.284580 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.284776 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.284776 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.285175 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.285379 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.285594 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.286346 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.286546 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.286753 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.286950 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.287133 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.287324 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.287524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.287718 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.287930 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288131 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288408 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288608 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288608 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288972 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.288972 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.289337 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.289517 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.289713 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.289909 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.290114 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.290307 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.290499 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.290675 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.290865 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291061 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291264 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291264 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291630 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291806 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.291979 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.292155 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.292403 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.292594 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.292773 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.292954 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.293134 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.293312 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.293513 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.293708 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.293883 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.294075 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.294267 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.294267 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.294636 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.294815 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295002 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295184 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295373 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295575 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295761 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.295955 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.296135 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.296387 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.296617 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.296831 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.297030 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.297228 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.297428 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.297637 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.297852 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.298050 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.298260 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.298469 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.298684 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.298898 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.299124 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.299124 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.299542 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.299756 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.299951 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.300147 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.300372 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.300573 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.300800 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.300995 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.301189 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.301415 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.301612 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.301812 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302018 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302227 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302435 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302634 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302828 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.302828 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.303216 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.303422 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.303625 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.303825 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.304031 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.304239 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.304517 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.304714 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.304916 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.305133 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.305333 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.305333 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.305718 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.305932 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.306128 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.306322 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.306523 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.306743 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.306943 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.307139 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.307337 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.307534 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.307730 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.307941 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.308148 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.308362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.308554 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.308756 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.308979 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.309181 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.309380 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.309581 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.309777 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.309989 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.310212 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.310415 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.310628 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.310836 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.311049 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.311249 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.311472 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.311688 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.311892 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.312105 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.312324 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.312527 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.312797 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.312995 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.313213 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.313420 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.313622 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.313821 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.314035 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.314239 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.314442 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.314644 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.314843 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.315124 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.315344 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.315553 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.315769 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.315985 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.316203 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.316483 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.316686 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.316887 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.317133 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.317329 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.317541 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.317754 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.317954 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.318150 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.318354 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.318558 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.318769 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.318983 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.319186 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.319385 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.319589 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.319752 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.319920 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.320075 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.320232 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.320405 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.320560 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.320692 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.321186 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.321391 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.321609 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.321802 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.321994 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.322192 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.322410 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.322622 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.322820 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.323034 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.323235 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.323446 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.323656 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.323862 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.324062 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.324281 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.324527 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.324847 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.325065 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.325269 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.325447 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.325633 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.325839 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.326059 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.326270 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.326477 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.326676 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.326876 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.327070 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.327283 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.327485 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.327681 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.327876 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.328072 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.328311 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.328536 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.328729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.328729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329120 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329120 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329506 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329506 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.329885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.330268 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.330477 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.330680 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.330870 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.331064 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.331265 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.331465 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.331666 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.331877 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.332071 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.332396 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.333123 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.333320 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.333545 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.333743 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.333941 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.334148 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.334347 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.334542 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.334855 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.335062 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.335062 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.335450 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.335639 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.335834 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.336049 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.336247 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.336460 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.336661 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.336858 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.337057 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.337274 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.337475 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.337475 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.337847 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.338062 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.338283 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.338477 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.338679 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.338885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.339070 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.339250 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.339464 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.339661 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.339860 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.340054 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.340251 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.340474 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.340695 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.340695 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.341082 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.341279 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.341475 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.341685 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.341880 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.342076 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.342284 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.342483 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.342696 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.342907 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.343102 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.343314 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.343512 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.343704 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.343913 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.344118 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.344347 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.344347 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.344726 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.344923 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.345142 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.345342 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.345559 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.345762 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.345957 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.346156 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.346368 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.346567 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.346769 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.346967 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.347164 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.347374 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.347571 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.347766 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.347969 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.348184 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.348971 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.349182 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.349364 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.349561 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.349747 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.349950 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350148 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350356 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350550 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350550 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350550 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.350550 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.351290 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.351503 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.351503 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.351885 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352089 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352089 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352514 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352724 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352919 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.352919 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.353302 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.353495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.353707 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.353903 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.354152 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.354358 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.354555 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.354757 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.354955 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.355152 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.355344 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.355545 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.355889 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.356105 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.356332 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.356533 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.356733 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.356932 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.357150 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.357364 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.357579 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.357785 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.357984 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.358178 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.358371 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.358592 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.358801 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359025 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359224 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359413 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359611 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359611 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.359977 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.360154 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.360394 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.360394 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.360796 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361006 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361197 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361385 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361585 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361782 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.361990 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.362188 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.362396 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.362592 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.362790 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.362988 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.363201 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.363410 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.363625 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.363812 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.364048 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.364246 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.364476 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.364676 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.364870 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.365073 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.365276 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.365493 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.365695 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.365897 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.366108 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.366306 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.366505 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.366719 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.366921 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.367128 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.367336 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.367550 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.367749 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.367959 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.368165 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.368389 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.368609 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.368827 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.369044 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.369258 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.369474 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.369654 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.369912 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.370119 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.370320 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.370521 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.370718 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.370920 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.371120 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.371316 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.371521 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.371718 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.371916 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.372126 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.372490 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.372693 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.373025 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.373227 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.373424 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.373619 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.373801 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.374001 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.374199 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.374401 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.374616 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.374809 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.375013 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.375230 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.375431 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.375629 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.375829 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.376041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.376241 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.376477 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.376676 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.376870 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.377082 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.377293 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.377502 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.377718 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.377907 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.378103 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.378315 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.378514 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.378729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.378729 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.379131 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.379334 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.379554 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.379554 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.379909 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.380109 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.380341 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.380525 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.380749 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.380945 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.381161 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.381366 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.381563 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.381761 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.381956 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.382157 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.382369 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.382570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.382782 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.382977 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.383179 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.383385 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.383585 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.383777 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.383975 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.384171 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.384423 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.384633 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.384830 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.385024 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.385226 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.385423 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.385622 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.385833 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.386036 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.386239 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.386448 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.386649 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.386863 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.387067 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.387278 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.387475 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.387676 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.387873 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.388083 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.388313 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.388514 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.388732 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.388928 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.389131 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.389351 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.389562 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.389760 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.389965 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.390150 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.390356 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.390548 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.390738 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.390956 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.391169 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.391369 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.391582 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.391782 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.391980 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.392191 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.392441 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.392657 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.392883 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.393088 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.393287 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.393502 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.393502 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.393897 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.394095 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.394551 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.394551 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.394937 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.395663 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.395882 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.396082 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.396320 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.396521 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.396736 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.396934 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.397145 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.397341 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.397537 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.397741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.397948 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.398150 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.398364 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.398576 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.398775 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.398976 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.399176 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.399407 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.399607 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.399808 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.400007 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.400196 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.400412 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.400624 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.400805 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.401018 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.401236 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.401435 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.401635 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.401850 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.402047 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.402260 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.402464 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.402667 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.402881 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.403084 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.403285 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.403477 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.403673 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.403881 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.404093 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.404401 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.404603 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.404804 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.404997 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.405185 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.405397 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.405592 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.405790 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.405988 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.406191 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.406191 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.406579 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.406776 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.406990 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.407199 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.407398 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.407615 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.407820 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.408024 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.408211 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.408442 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.408647 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.408872 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.409070 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.409281 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.409491 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.409692 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.409891 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.410102 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.410300 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.410493 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.410687 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.411463 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.411646 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.411941 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.412156 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.412397 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.412588 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.412890 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.413102 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.413302 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.413499 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.413694 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.413895 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.414095 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.414307 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.414505 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.414700 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.414897 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.415097 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.415296 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.415507 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.415706 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.415902 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.416103 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.416340 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.416542 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.416758 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.416954 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.417155 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.417358 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.417563 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.417775 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.417987 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.418182 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.418376 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.418575 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.418782 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.418996 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.419197 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.419395 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.419594 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.419787 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.419990 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.420212 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.420467 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.420648 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.420855 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.421056 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.421269 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.421464 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.421666 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.421855 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.422034 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.422233 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.422460 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.422664 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.422872 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.423084 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.423288 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.423488 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.423700 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.423910 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.424129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.424357 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.424557 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.424775 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.424972 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.425163 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.425360 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.425563 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.425758 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.425977 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.426176 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.426404 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.426606 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.426813 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.427011 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.427227 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.427426 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.427631 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.427824 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.428020 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.428214 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.428457 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.428654 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.428854 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.429057 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.429257 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.429486 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.429687 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.429883 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.430077 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.430275 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.430473 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.430698 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 09:16:29.430881 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:16:29.430881 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103825) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 09:16:29.439821 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO dbcounter [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Registered counter for database nova_api Jun 04 09:16:29.442143 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO dbcounter [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Registered counter for database nova_api Jun 04 09:16:29.464667 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_db.sqlalchemy.engines [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.466788 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_db.sqlalchemy.engines [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.472921 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writer thread running {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.478144 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writer thread running {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.539812 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.context [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),074277cd-5d2b-4eb5-8cdc-e149db967384(cell1) {{(pid=103826) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 09:16:29.543089 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.context [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),074277cd-5d2b-4eb5-8cdc-e149db967384(cell1) {{(pid=103825) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 09:16:29.544212 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_concurrency.lockutils [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:16:29.545930 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_concurrency.lockutils [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:16:29.546779 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_concurrency.lockutils [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:16:29.547430 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:16:29.548911 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_concurrency.lockutils [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:16:29.549129 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:16:29.549964 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:16:29.551055 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO dbcounter [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Registered counter for database nova_cell0 Jun 04 09:16:29.552195 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:16:29.554449 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO dbcounter [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Registered counter for database nova_cell0 Jun 04 09:16:29.555682 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO dbcounter [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Registered counter for database nova_cell1 Jun 04 09:16:29.559089 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO dbcounter [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Registered counter for database nova_cell1 Jun 04 09:16:29.565580 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_db.sqlalchemy.engines [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.567853 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_db.sqlalchemy.engines [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.570863 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_db.sqlalchemy.engines [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.574491 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_db.sqlalchemy.engines [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.578304 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writer thread running {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.579816 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writer thread running {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.582568 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writer thread running {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.731191 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writer thread running {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.742107 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO dbcounter [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Registered counter for database nova_cell0 Jun 04 09:16:29.747997 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO dbcounter [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Registered counter for database nova_cell0 Jun 04 09:16:29.754096 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_db.sqlalchemy.engines [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103825) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.760890 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG oslo_db.sqlalchemy.engines [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:16:29.762293 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writer thread running {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:29.765865 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writer thread running {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:16:30.357929 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: WARNING keystonemiddleware.auth_token [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:16:30.365322 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: WARNING keystonemiddleware.auth_token [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:16:30.367060 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: WARNING keystonemiddleware.auth_token [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:16:30.372916 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: WARNING keystonemiddleware.auth_token [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:16:30.599044 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: WARNING keystonemiddleware.auth_token [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:16:30.603035 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: WARNING keystonemiddleware.auth_token [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:16:30.605582 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: WARNING keystonemiddleware.auth_token [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:16:30.609365 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: WARNING keystonemiddleware.auth_token [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:16:30.611242 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c85553c9c0 pid: 103826 (default app) Jun 04 09:16:30.615342 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c85553c9c0 pid: 103825 (default app) Jun 04 09:16:30.615652 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:16:30.617073 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d3082909-8bf5-4b3a-8738-3fd604ee839a None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004041 Jun 04 09:16:30.617603 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Sat Jun 4 09:16:30 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:06.889248 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:06.890856 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002754 Jun 04 09:18:06.891607 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:06.906719 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_api:SELECT=3 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:06.908393 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_cell0:SELECT=3 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:06.909718 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_cell1:SELECT=3 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:06.910742 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:07.713454 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-5a9702eb-7820-46e4-87d2-d453d6f6dfea admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:07.775608 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-5a9702eb-7820-46e4-87d2-d453d6f6dfea admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.874037 Jun 04 09:18:07.777132 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jun 4 09:18:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:10.451571 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:10.452633 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-e346c532-ecb4-4da6-9bd7-e24abd7ebb44 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 04 09:18:10.455413 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:18:10.521003 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-3a187df4-3865-4961-a042-be3e1b8d285e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 256, "name": "cirros256", "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:10.541485 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:18:10.541485 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: warnings.warn(msg) Jun 04 09:18:10.635036 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-3a187df4-3865-4961-a042-be3e1b8d285e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175160 Jun 04 09:18:10.635626 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:10.650884 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=3 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:10.651790 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_cell1:SELECT=3 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:10.652692 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_cell0:SELECT=3 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:10.653548 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:10.866054 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-3c443f37-8234-4302-8a87-b663cef7664c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:10.869259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:18:10.869259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:18:10.993552 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-3c443f37-8234-4302-8a87-b663cef7664c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349113 Jun 04 09:18:10.994577 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jun 4 09:18:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:18:13.962622 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-3a187df4-3865-4961-a042-be3e1b8d285e admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:13.964493 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-3a187df4-3865-4961-a042-be3e1b8d285e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002453 Jun 04 09:18:13.965143 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:18:14.144423 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-57b0f2c5-4470-40e6-99d5-176121ce0c42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:14.174469 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:18:14.174469 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:18:14.307424 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-57b0f2c5-4470-40e6-99d5-176121ce0c42 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.333043 Jun 04 09:18:14.308610 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:14.330695 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-52d7c738-5dba-4322-9415-d29e13cfc330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:14.333908 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:18:14.333908 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: warnings.warn(msg) Jun 04 09:18:14.474507 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-52d7c738-5dba-4322-9415-d29e13cfc330 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150935 Jun 04 09:18:14.476004 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jun 4 09:18:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:18.027689 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-57b0f2c5-4470-40e6-99d5-176121ce0c42 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:18.029747 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-57b0f2c5-4470-40e6-99d5-176121ce0c42 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002729 Jun 04 09:18:18.030642 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:18.100354 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-8d43cb2d-f07e-4d40-8f18-407900d3a1b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:18.183878 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-8d43cb2d-f07e-4d40-8f18-407900d3a1b4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146454 Jun 04 09:18:18.185027 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:18:18.206974 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-c09ad721-e86f-4263-82d7-a43117bbce19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:18.297904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-c09ad721-e86f-4263-82d7-a43117bbce19 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101156 Jun 04 09:18:18.299666 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jun 4 09:18:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:21.195825 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-8d43cb2d-f07e-4d40-8f18-407900d3a1b4 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:21.196985 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-8d43cb2d-f07e-4d40-8f18-407900d3a1b4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Jun 04 09:18:21.197397 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:21.271616 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-150b5713-882b-4b63-8df0-de522214fe17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:21.420054 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-150b5713-882b-4b63-8df0-de522214fe17 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.215404 Jun 04 09:18:21.421545 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:21.438282 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-66d30521-ff60-4a1a-88e4-36211deb1e48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:21.589065 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-66d30521-ff60-4a1a-88e4-36211deb1e48 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.155070 Jun 04 09:18:21.591983 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jun 4 09:18:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:24.876772 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-150b5713-882b-4b63-8df0-de522214fe17 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:24.879259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-150b5713-882b-4b63-8df0-de522214fe17 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003271 Jun 04 09:18:24.880386 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:24.946997 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "name": "ds4G", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:25.074538 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.186673 Jun 04 09:18:25.075299 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:18:25.089492 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-ed45ae2c-523c-4c23-a630-35f810618ccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:25.187360 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-ed45ae2c-523c-4c23-a630-35f810618ccb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101813 Jun 04 09:18:25.188375 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Sat Jun 4 09:18:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:18:28.728485 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:28.731417 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005271 Jun 04 09:18:28.732188 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:28.848796 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-d52f1f43-1f15-41b0-8896-76e33d1cf60f admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:28.900560 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-d52f1f43-1f15-41b0-8896-76e33d1cf60f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.160285 Jun 04 09:18:28.901628 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jun 4 09:18:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:18:31.847564 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:31.849302 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a40e42cd-ec2c-46ae-b255-082adc3a9c92 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Jun 04 09:18:31.849944 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:31.968923 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-56e77066-7c29-4e9a-9c90-c604ba2f0e5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:32.077988 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-56e77066-7c29-4e9a-9c90-c604ba2f0e5a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.216988 Jun 04 09:18:32.078926 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:32.094316 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-41401458-d92f-47a9-b79d-14045ba585a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:32.187992 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-41401458-d92f-47a9-b79d-14045ba585a6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098094 Jun 04 09:18:32.188753 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jun 4 09:18:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:35.240000 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-56e77066-7c29-4e9a-9c90-c604ba2f0e5a admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:35.241498 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-56e77066-7c29-4e9a-9c90-c604ba2f0e5a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Jun 04 09:18:35.242051 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:18:35.352073 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a69ee921-1aa2-432d-8274-2dad1c4a85b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "ram": 2048, "vcpus": 1}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:35.488625 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a69ee921-1aa2-432d-8274-2dad1c4a85b0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.239122 Jun 04 09:18:35.489319 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:35.506826 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-2569d9a6-d8dc-4fb0-8236-344358ba66cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:35.600942 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-2569d9a6-d8dc-4fb0-8236-344358ba66cc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101051 Jun 04 09:18:35.602254 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jun 4 09:18:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:18:38.180518 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a69ee921-1aa2-432d-8274-2dad1c4a85b0 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:38.182189 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a69ee921-1aa2-432d-8274-2dad1c4a85b0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002413 Jun 04 09:18:38.182837 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:38.259652 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-0952ea04-4591-4faf-a4bc-fb96bf8ac6b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:38.352934 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-0952ea04-4591-4faf-a4bc-fb96bf8ac6b5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.162641 Jun 04 09:18:38.356814 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:18:38.368744 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-ade08e62-502e-4c7b-b2e2-cdd550dd0253 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:38.372760 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:38.499344 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-ade08e62-502e-4c7b-b2e2-cdd550dd0253 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135724 Jun 04 09:18:38.500384 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jun 4 09:18:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:18:41.020800 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-0952ea04-4591-4faf-a4bc-fb96bf8ac6b5 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:41.022350 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-0952ea04-4591-4faf-a4bc-fb96bf8ac6b5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Jun 04 09:18:41.022898 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:41.093141 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-e20435be-cc8c-4995-9f57-ae3d4719ef9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:41.187928 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-e20435be-cc8c-4995-9f57-ae3d4719ef9a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.157159 Jun 04 09:18:41.189637 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:18:41.207066 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-3cdb78cd-b575-4fbb-b0f7-dd92760b98f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:41.214043 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:18:41.319650 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-3cdb78cd-b575-4fbb-b0f7-dd92760b98f4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118117 Jun 04 09:18:41.321243 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jun 4 09:18:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:18:44.280844 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-e20435be-cc8c-4995-9f57-ae3d4719ef9a admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:18:44.281873 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-e20435be-cc8c-4995-9f57-ae3d4719ef9a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 04 09:18:44.282493 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:18:44.367852 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:44.448388 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.159291 Jun 04 09:18:44.448946 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Sat Jun 4 09:18:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:18:44.470084 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-0c976760-76fe-4a26-bc66-82b005468799 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:18:44.567740 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-0c976760-76fe-4a26-bc66-82b005468799 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104505 Jun 04 09:18:44.568990 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Sat Jun 4 09:18:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:19:08.315517 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:08.321347 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 04 09:19:08.321347 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:19:08.330110 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:19:08.388632 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-581e14cb-23f6-4cd5-b45c-00855974cde1 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:08.408028 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-581e14cb-23f6-4cd5-b45c-00855974cde1 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083741 Jun 04 09:19:08.408636 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jun 4 09:19:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:19:09.720581 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:09.722317 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-85d5fb10-b1bc-453d-a393-8e4ff72e687a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Jun 04 09:19:09.722824 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:09.974666 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-fb00fae2-b670-4ada-945d-1b26b1092d0e admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:09.980988 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.wsgi [None req-fb00fae2-b670-4ada-945d-1b26b1092d0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-fb00fae2-b670-4ada-945d-1b26b1092d0e admin admin] Request method failure captured: Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept: application/json Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept-Encoding: gzip, deflate Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Connection: keep-alive Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Content-Length: 0 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Host: 10.222.0.46 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-System-Scope: None Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: User-Agent: python-novaclient Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Auth-Token: gAAAAABimyONt0od03BXME8u3TNSL-jl6Ai7RCgWCSXrGtrIhqUHzHeApkTnlU3jmk5TmtJHuRBP0KgERDJ25eK-cJVkB5u2z4YklKcGJ7PnDB72TaHt4q7gknlgKvahFU-mkQwf1AbtKD_Ht58JnmDG8nf0Qm0fWmHGvqlTML-dyZtAfetJ4RA Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Id: None Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Name: None Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Identity-Status: Confirmed Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Is-Admin-Project: True Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Id: default Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Name: Default Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Name: admin Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Role: member,reader,admin Jun 04 09:19:09.984433 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Roles: member,reader,admin Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant: admin Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Name: admin Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User: admin Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Id: default Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Name: Default Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Name: admin Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: method: > Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: exception: Flavor 42 could not be found. Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: action_args: {'id': '42'} Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:09.988041 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:09.989129 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:09.990495 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-fb00fae2-b670-4ada-945d-1b26b1092d0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:09.991795 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-fb00fae2-b670-4ada-945d-1b26b1092d0e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.103080 Jun 04 09:19:09.991795 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jun 4 09:19:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 04 09:19:09.998694 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-a3a42f01-2488-464e-a376-8342447ac9ea admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:10.001810 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:19:10.022613 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-a3a42f01-2488-464e-a376-8342447ac9ea admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027686 Jun 04 09:19:10.023206 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:19:10.039072 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-675fe44d-6640-41fe-b91f-7c3e985e3e50 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:10.081802 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-675fe44d-6640-41fe-b91f-7c3e985e3e50 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.049162 Jun 04 09:19:10.082858 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:19:10.095939 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-ba0264f9-809b-48e9-a84a-8236d51fbdee admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:10.102152 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.wsgi [None req-ba0264f9-809b-48e9-a84a-8236d51fbdee admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-ba0264f9-809b-48e9-a84a-8236d51fbdee admin admin] Request method failure captured: Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept: application/json Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept-Encoding: gzip, deflate Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Connection: keep-alive Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Content-Length: 0 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Host: 10.222.0.46 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-System-Scope: None Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: User-Agent: python-novaclient Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Auth-Token: gAAAAABimyONt0od03BXME8u3TNSL-jl6Ai7RCgWCSXrGtrIhqUHzHeApkTnlU3jmk5TmtJHuRBP0KgERDJ25eK-cJVkB5u2z4YklKcGJ7PnDB72TaHt4q7gknlgKvahFU-mkQwf1AbtKD_Ht58JnmDG8nf0Qm0fWmHGvqlTML-dyZtAfetJ4RA Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Id: None Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Name: None Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Identity-Status: Confirmed Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Is-Admin-Project: True Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Id: default Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Name: Default Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Name: admin Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Role: member,reader,admin Jun 04 09:19:10.106031 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Roles: member,reader,admin Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant: admin Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Name: admin Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User: admin Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Id: default Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Name: Default Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Name: admin Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: method: > Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: exception: Flavor 42 could not be found. Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: action_args: {'id': '42'} Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:10.113750 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:10.115524 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:10.117779 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-ba0264f9-809b-48e9-a84a-8236d51fbdee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:10.119884 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-ba0264f9-809b-48e9-a84a-8236d51fbdee admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015759 Jun 04 09:19:10.119884 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jun 4 09:19:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 09:19:11.025299 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-675fe44d-6640-41fe-b91f-7c3e985e3e50 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:11.026325 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-675fe44d-6640-41fe-b91f-7c3e985e3e50 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002356 Jun 04 09:19:11.026739 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:19:11.258089 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-6377feff-8765-4347-8d84-57338aad22b3 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:11.265338 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.wsgi [None req-6377feff-8765-4347-8d84-57338aad22b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-6377feff-8765-4347-8d84-57338aad22b3 admin admin] Request method failure captured: Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept: application/json Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept-Encoding: gzip, deflate Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Connection: keep-alive Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Content-Length: 0 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Host: 10.222.0.46 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-System-Scope: None Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: User-Agent: python-novaclient Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Auth-Token: gAAAAABimyOP6f35dUOo3PtduxknhQG1MSrBkzQ1CvimHK_GvHX24qF_ssme8f5z9-MJZRwg-9WznQ-OSfcHKi8M7J400hOFIP85EiF1b3Wn4Oq_COc5RGhrFweWi5JiEvC0GJ8w6vv1Rc1WsNVL1z1qzgwYT9kic4l4MsLEGDFA809y4CzKBvo Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Id: None Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Name: None Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Identity-Status: Confirmed Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Is-Admin-Project: True Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Id: default Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Name: Default Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Name: admin Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Role: member,reader,admin Jun 04 09:19:11.267003 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Roles: member,reader,admin Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant: admin Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Name: admin Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User: admin Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Id: default Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Name: Default Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Name: admin Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: method: > Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: exception: Flavor 84 could not be found. Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: action_args: {'id': '84'} Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:11.273836 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:11.275467 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.276904 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-6377feff-8765-4347-8d84-57338aad22b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:11.278152 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-6377feff-8765-4347-8d84-57338aad22b3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075629 Jun 04 09:19:11.278152 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jun 4 09:19:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 09:19:11.282848 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-07d586f5-cc1d-4180-b65e-69409a3321c7 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:11.298988 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-07d586f5-cc1d-4180-b65e-69409a3321c7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020051 Jun 04 09:19:11.299571 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:19:11.310920 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-1c338c72-523d-42a7-916d-50ff5e21e5b2 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:11.326401 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-1c338c72-523d-42a7-916d-50ff5e21e5b2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019515 Jun 04 09:19:11.327001 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:19:11.343406 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-ce46fbee-9150-42ff-966f-f1eb027d129e admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:11.349422 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.wsgi [None req-ce46fbee-9150-42ff-966f-f1eb027d129e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-ce46fbee-9150-42ff-966f-f1eb027d129e admin admin] Request method failure captured: Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept: application/json Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept-Encoding: gzip, deflate Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Connection: keep-alive Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Content-Length: 0 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Host: 10.222.0.46 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-System-Scope: None Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: User-Agent: python-novaclient Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Auth-Token: gAAAAABimyOP6f35dUOo3PtduxknhQG1MSrBkzQ1CvimHK_GvHX24qF_ssme8f5z9-MJZRwg-9WznQ-OSfcHKi8M7J400hOFIP85EiF1b3Wn4Oq_COc5RGhrFweWi5JiEvC0GJ8w6vv1Rc1WsNVL1z1qzgwYT9kic4l4MsLEGDFA809y4CzKBvo Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Id: None Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Name: None Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Identity-Status: Confirmed Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Is-Admin-Project: True Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Id: default Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Name: Default Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Name: admin Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Role: member,reader,admin Jun 04 09:19:11.351111 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Roles: member,reader,admin Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant: admin Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Name: admin Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User: admin Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Id: default Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Name: Default Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Name: admin Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: method: > Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: exception: Flavor 84 could not be found. Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: action_args: {'id': '84'} Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:11.353570 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:11.355357 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:11.357362 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-ce46fbee-9150-42ff-966f-f1eb027d129e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:11.359158 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-ce46fbee-9150-42ff-966f-f1eb027d129e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012862 Jun 04 09:19:11.359158 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Jun 4 09:19:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 09:19:12.290956 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-1c338c72-523d-42a7-916d-50ff5e21e5b2 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:12.292004 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-1c338c72-523d-42a7-916d-50ff5e21e5b2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 04 09:19:12.292512 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:19:12.497710 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-7731d6e0-115f-4096-a51f-af71cca8e9fb admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:12.506178 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.wsgi [None req-7731d6e0-115f-4096-a51f-af71cca8e9fb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-7731d6e0-115f-4096-a51f-af71cca8e9fb admin admin] Request method failure captured: Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept: application/json Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Accept-Encoding: gzip, deflate Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Connection: keep-alive Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Content-Length: 0 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Host: 10.222.0.46 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Openstack-System-Scope: None Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: User-Agent: python-novaclient Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Auth-Token: gAAAAABimyOQxj5IUFpVlblLOZyPCyUBz5XyTVtm6Ye-AOAl9NiQLNlzFWHVCrVqxChNm_OJ7ADvyRByBMd_JKg7Z4ysqlcY0fwMmEbMmXY8qnsjflbW4Jsjkvo-nXIDdU6fAtnN5HJ0UZdETzYTWazhWVymJIz8Dh06ONJESxy854TmtjQc_aE Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Id: None Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Domain-Name: None Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Identity-Status: Confirmed Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Is-Admin-Project: True Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Id: default Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Domain-Name: Default Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Project-Name: admin Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Role: member,reader,admin Jun 04 09:19:12.507741 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Roles: member,reader,admin Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant: admin Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-Tenant-Name: admin Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User: admin Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Id: default Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Domain-Name: Default Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: X-User-Name: admin Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: method: > Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: exception: Flavor 451 could not be found. Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: action_args: {'id': '451'} Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:12.510163 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:12.511463 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.512569 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-7731d6e0-115f-4096-a51f-af71cca8e9fb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:12.513568 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-7731d6e0-115f-4096-a51f-af71cca8e9fb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.074064 Jun 04 09:19:12.513568 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:19:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 04 09:19:12.520443 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-32b1ae81-78ef-4835-a715-e9b8774b9bfa admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:12.536560 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-32b1ae81-78ef-4835-a715-e9b8774b9bfa admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020211 Jun 04 09:19:12.537163 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:19:12.551600 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:12.578500 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033273 Jun 04 09:19:12.579523 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Jun 4 09:19:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:19:12.591434 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-42c60114-f704-456c-85f2-97328c2c0eee admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:12.597634 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.wsgi [None req-42c60114-f704-456c-85f2-97328c2c0eee admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-42c60114-f704-456c-85f2-97328c2c0eee admin admin] Request method failure captured: Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept: application/json Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Accept-Encoding: gzip, deflate Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Connection: keep-alive Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Content-Length: 0 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Host: 10.222.0.46 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-Api-Version: compute 2.90 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Openstack-System-Scope: None Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: User-Agent: python-novaclient Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Auth-Token: gAAAAABimyOQxj5IUFpVlblLOZyPCyUBz5XyTVtm6Ye-AOAl9NiQLNlzFWHVCrVqxChNm_OJ7ADvyRByBMd_JKg7Z4ysqlcY0fwMmEbMmXY8qnsjflbW4Jsjkvo-nXIDdU6fAtnN5HJ0UZdETzYTWazhWVymJIz8Dh06ONJESxy854TmtjQc_aE Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Id: None Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Domain-Name: None Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Identity-Status: Confirmed Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Is-Admin-Project: True Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Id: default Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Domain-Name: Default Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Project-Name: admin Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Role: member,reader,admin Jun 04 09:19:12.599223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Roles: member,reader,admin Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fbd4724a5a83452ab3b4b7b3823eccc9", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fbd4724a5a83452ab3b4b7b3823eccc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant: admin Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Id: fbd4724a5a83452ab3b4b7b3823eccc9 Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-Tenant-Name: admin Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User: admin Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Id: default Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Domain-Name: Default Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Id: 8d4e8588f0b448199c8c5e35afe88ad4 Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: X-User-Name: admin Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: method: > Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: exception: Flavor 451 could not be found. Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: action_args: {'id': '451'} Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:19:12.601716 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:12.603985 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: ERROR nova.api.openstack.wsgi Jun 04 09:19:12.606194 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-42c60114-f704-456c-85f2-97328c2c0eee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103825) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:19:12.608253 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-42c60114-f704-456c-85f2-97328c2c0eee admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012999 Jun 04 09:19:12.608253 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:19:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 09:19:13.568660 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:13.569862 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jun 04 09:19:13.570261 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:13.770583 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-78e8e1de-2c7f-4ede-a93d-2d7a9c91f7bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:19:13.863092 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-78e8e1de-2c7f-4ede-a93d-2d7a9c91f7bd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.150730 Jun 04 09:19:13.863736 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jun 4 09:19:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:19:14.825902 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:14.826928 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 04 09:19:14.827356 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:15.027790 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-e7aeecb2-a325-4222-ab52-88a2efef075b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:19:15.117885 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-e7aeecb2-a325-4222-ab52-88a2efef075b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.149473 Jun 04 09:19:15.124159 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jun 4 09:19:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:19:16.049302 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:16.051117 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Jun 04 09:19:16.051872 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:16.274343 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-6f6bad4b-322b-4316-9c01-9509ad3dd98b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:19:16.356991 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-6f6bad4b-322b-4316-9c01-9509ad3dd98b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.139119 Jun 04 09:19:16.358165 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jun 4 09:19:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:19:17.292868 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:17.294027 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jun 04 09:19:17.294540 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:17.499145 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-77ae4435-22e4-4687-a2d2-aa89bd22742d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:19:17.604842 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-77ae4435-22e4-4687-a2d2-aa89bd22742d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.164341 Jun 04 09:19:17.606349 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Jun 4 09:19:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:19:18.705919 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:18.707045 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Jun 04 09:19:18.707581 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:19:18.916125 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-df7c7e25-7851-43bd-99f0-7a3642b326a9 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:19:18.954279 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-df7c7e25-7851-43bd-99f0-7a3642b326a9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.101409 Jun 04 09:19:18.955259 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Sat Jun 4 09:19:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:20:24.985442 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:24.986813 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-d22d2ca2-ffe9-465e-b9c0-856f36908100 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001878 Jun 04 09:20:24.987435 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Sat Jun 4 09:20:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:20:24.996367 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:20:25.053125 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-7ccd31d5-5b8f-4c29-97f0-61b58dedc2f7 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:25.073536 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-7ccd31d5-5b8f-4c29-97f0-61b58dedc2f7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079172 Jun 04 09:20:25.074097 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Sat Jun 4 09:20:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:20:25.094968 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG dbcounter [-] [103826] Writing DB stats nova_api:SELECT=14 {{(pid=103826) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:20:25.098821 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-c8da0fd9-ed24-4663-9aa9-d0bdda5d4317 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:25.107319 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-c8da0fd9-ed24-4663-9aa9-d0bdda5d4317 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013713 Jun 04 09:20:25.109039 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Sat Jun 4 09:20:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:20:25.119981 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-e41ea1fc-5492-4ba6-90e3-b757a44a758a admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:25.129246 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-e41ea1fc-5492-4ba6-90e3-b757a44a758a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013051 Jun 04 09:20:25.129816 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Sat Jun 4 09:20:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:20:25.143037 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:25.151348 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012774 Jun 04 09:20:25.151975 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Sat Jun 4 09:20:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:20:25.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-fca3a357-69e9-455f-9858-c3d4e4231739 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:20:25.174645 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-fca3a357-69e9-455f-9858-c3d4e4231739 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013038 Jun 04 09:20:25.175119 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Sat Jun 4 09:20:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:24:00.541543 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:00.542633 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 04 09:24:00.543164 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:24:00.711551 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=6 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:24:00.875734 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:00.877019 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:24:00.877019 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:24:00.878340 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:00.878785 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:00.879589 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:00.880020 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:00.918547 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-9cbe31b9-9a02-4401-92e7-2066f1bff440 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.212862 Jun 04 09:24:00.919166 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:24:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:24:01.937356 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:01.939149 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002538 Jun 04 09:24:01.939908 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:24:02.149483 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:02.151024 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:24:02.151024 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:24:02.152698 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:02.153150 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:02.153950 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:02.154383 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:02.176692 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-ebe95002-ad24-4860-ae9e-10aa3637df95 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.094974 Jun 04 09:24:02.177424 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 36/72] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:24:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:24:13.578293 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:13.579360 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 04 09:24:13.579802 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:24:13.738500 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_cell0:SELECT=4 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:24:13.739268 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_cell1:SELECT=4 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:24:13.739899 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG dbcounter [-] [103825] Writing DB stats nova_api:SELECT=8 {{(pid=103825) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:24:13.821843 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:13.823341 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:24:13.823341 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:24:13.824991 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:13.825550 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:13.826575 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:13.827106 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:13.855644 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-455b23cd-a374-47be-951c-58ac25050669 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.122468 Jun 04 09:24:13.856242 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 37/74] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:24:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:24:14.827275 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: DEBUG nova.api.openstack.wsgi [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] Calling method '>' {{(pid=103826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:14.828562 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: INFO nova.api.openstack.requestlog [None req-a5dd13ce-7e45-42ad-81a8-deaeb224ea71 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Jun 04 09:24:14.829125 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: [pid: 103826|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Jun 4 09:24:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:24:15.038820 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG nova.api.openstack.wsgi [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] Calling method '>' {{(pid=103825) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:24:15.041112 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 09:24:15.041112 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: warnings.warn(msg) Jun 04 09:24:15.043424 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:15.044223 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:15.045709 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:24:15.046496 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: DEBUG oslo_concurrency.lockutils [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103825) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:24:15.086769 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: INFO nova.api.openstack.requestlog [None req-49ca5523-2e28-49ce-8b8c-3b4cfadfaecb admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.115658 Jun 04 09:24:15.087732 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: [pid: 103825|app: 0|req: 38/76] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Jun 4 09:24:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:25:12.773468 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: Sat Jun 4 09:25:12 2022 - graceful shutdown triggered... Jun 04 09:25:12.773464 dv-cinder-844695-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 04 09:25:12.775178 dv-cinder-844695-1-iscsi devstack@n-api.service[103825]: Gracefully killing worker 1 (pid: 103825)... Jun 04 09:25:12.775701 dv-cinder-844695-1-iscsi devstack@n-api.service[103826]: Gracefully killing worker 2 (pid: 103826)... Jun 04 09:25:13.776015 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: worker 1 buried after 1 seconds Jun 04 09:25:13.776015 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: worker 2 buried after 1 seconds Jun 04 09:25:13.776015 dv-cinder-844695-1-iscsi devstack@n-api.service[103824]: goodbye to uWSGI. Jun 04 09:25:13.777902 dv-cinder-844695-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 04 09:25:13.778456 dv-cinder-844695-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 04 09:25:13.781205 dv-cinder-844695-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 09:25:13.802416 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 09:25:13 2022] *** Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: nodename: dv-cinder-844695-1-iscsi Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: machine: x86_64 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: clock source: unix Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: pcre jit disabled Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: detected number of CPU cores: 4 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: current working directory: / Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: detected binary path: /usr/bin/uwsgi-core Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: your processes number limit is 47680 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: your memory page size is 4096 bytes Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: detected max file descriptor number: 2048 Jun 04 09:25:13.821663 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: lock engine: pthread robust mutexes Jun 04 09:25:13.823320 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: thunder lock: enabled Jun 04 09:25:13.823320 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 09:25:13.823320 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 09:25:13.870105 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: Python main interpreter initialized at 0x558e056949c0 Jun 04 09:25:13.870105 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: python threads support enabled Jun 04 09:25:13.870105 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: your server socket listen backlog is limited to 100 connections Jun 04 09:25:13.870105 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: your mercy for graceful operations on workers is 90 seconds Jun 04 09:25:13.870834 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 09:25:13.870834 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: *** Operational MODE: preforking *** Jun 04 09:25:13.870834 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: *** uWSGI is running in multiple interpreter mode *** Jun 04 09:25:13.870834 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: spawned uWSGI master process (pid: 118474) Jun 04 09:25:13.871125 dv-cinder-844695-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 04 09:25:13.872516 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: spawned uWSGI worker 1 (pid: 118476, cores: 1) Jun 04 09:25:13.873171 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: spawned uWSGI worker 2 (pid: 118477, cores: 1) Jun 04 09:25:13.873472 dv-cinder-844695-1-iscsi devstack@n-api.service[118474]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 09:25:15.176352 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 09:25:15.522861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 09:25:16.042085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:25:16.042085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: from cryptography.utils import int_from_bytes Jun 04 09:25:16.042508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:25:16.042508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: from cryptography.utils import int_from_bytes Jun 04 09:25:16.252755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:25:16.252755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: from cryptography.utils import int_from_bytes Jun 04 09:25:16.253138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 09:25:16.253138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: from cryptography.utils import int_from_bytes Jun 04 09:25:18.630877 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 09:25:18.631683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 09:25:18.631683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 09:25:18.631966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 09:25:18.632483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 09:25:18.633587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.633587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.633587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.633587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.634139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.634288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.634619 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.634860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.635150 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.635446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844695-1-iscsi {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.640353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.641477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.642272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.642272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.642529 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.642653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.643485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.643485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844695-1-iscsi {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.645452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.649030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.658105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.659929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.662880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.664665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.670495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.682565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.684105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.685681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.687585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.690189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.693631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:18.696939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.698755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.700757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.703203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.705038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.706847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.708624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.713072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.714883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.716737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.718496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.721081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.724185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.725899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.727681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.729374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.730854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.733555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.735370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.737248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.738978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.740652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.742411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.744674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.746314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.747942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.749206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.750632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.751785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.752823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.754788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.754788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.754788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.754788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.755354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.755354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.755580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.755743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.756065 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.756404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.756712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.757030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.757344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.757653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.757961 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.758277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.758592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.758898 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.759205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.759517 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.759831 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.760140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.760479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.760811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.761128 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.761436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.761745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.762058 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.762364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.762672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.762982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.763308 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.763629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.763951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.764440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.764636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.764890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.765200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.765511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.765817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.766122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.766427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.766733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.767042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.767372 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.767683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.767989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.768390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.768626 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.769549 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.769862 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.770226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.770534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.770853 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.771174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.771494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.771808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.772126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.772479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.773069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.773389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.773708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.774015 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.774820 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.774820 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.775299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.775299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.775773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.776005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.776218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.776539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.776827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.777150 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.777464 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.777777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.778091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.778409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.778725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.779041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.779357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.779674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.779990 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.780334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.780654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.780967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.781308 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.781624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.781933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.782248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.782560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.782875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.783183 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.783639 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.783954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.784272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.784895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.785130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.785376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.785591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.785914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.786220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.786674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.787093 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.787359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.787607 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.787918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.788227 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.788552 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.788901 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.789214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.789526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.789837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.790168 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.790481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.790809 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.791258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.791577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.791893 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.792357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.792681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.792998 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.793328 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.793659 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.793992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.794304 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.794630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.795049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.795298 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.795578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.795898 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.796218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.796560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.796889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.797228 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.797550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.797877 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.798323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.798650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.798971 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.799312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.799645 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.799956 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.800364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.800654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.800969 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.801281 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.801613 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.801924 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.802247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.802568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.802884 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.803192 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.803505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.803838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.804141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.804506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.804833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.805158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.805484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.805796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.806121 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.806443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.806754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.807070 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.807382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.807734 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.808044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.808401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.808742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.809077 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.809393 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.809738 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.810069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.810387 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.810710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.811042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.811349 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.811659 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.811975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.812319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.812646 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.812956 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.813271 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.813581 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.813894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.814202 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.814542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.814851 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.817023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.817401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.817741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.818069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.818391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.818766 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.819092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.819445 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.819781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.820116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.820498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.820823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.821163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.821493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.821820 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.822145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.822474 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.823005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.823166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.823446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.823765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.824090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.824442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.824772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.825523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.825777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.826019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.826344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.826741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.826981 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.827299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.827623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.828273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.828640 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.828964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.829315 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.829651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.829987 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.830336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.830663 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.830989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.831339 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.832204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.832611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.832938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.833255 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.833579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.833902 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.834226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.834549 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.834866 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.835186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.835573 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.835875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.836193 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.836539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.836851 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.837205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.837551 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.837885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.838206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.838524 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.838844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.839435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.839756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.840092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.840485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.840817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.841140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.841470 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.841806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.842118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.842429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.842749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.843056 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.843372 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.843707 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.844022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.844429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.844761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.845080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.845687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.846049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.846375 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.846709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.847696 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.847918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.848210 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.848601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.848873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.849191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.849516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.849832 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.850141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.850451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.850771 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.851084 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.851390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.851709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.852019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.853523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.853523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.853523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.853523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.855596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.856828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.856828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.856828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.856828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.857499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.857499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.857761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.857914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.858164 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.858494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.858809 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.859138 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.859456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.859770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.860128 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.860478 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.861090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.861430 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.861759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.862110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.862448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.864217 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.864217 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.864217 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.864771 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.864771 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.865135 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.865344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.865549 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.865803 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.866121 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.866434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.866749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.867063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.867378 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.867698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.868013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.868513 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.868676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.869037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.869364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.869685 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.870007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.870327 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.870640 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.870954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.871267 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.871579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.871897 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.872233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.872576 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.872888 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.873362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.873671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.874250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.874250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.874618 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.874891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.875200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.875516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.875841 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.876153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.876512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.876860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.877195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.877523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.877838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.878289 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.878617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.878933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.879258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.879572 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.879878 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.880185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.880535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.880842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.881218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.881522 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.881764 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.882072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.882377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.882682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.882987 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.883292 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.883599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.883903 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.884542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.884542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.885081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.885249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.885415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.885702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.886045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.886380 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.886698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.887026 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.887341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.887664 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.888094 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.888385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.888645 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.889080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.889295 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.889602 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.889915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.890232 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.890534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.890850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.891163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.891476 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.891809 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.892141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.892501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.892833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.893158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.893484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.893833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.894606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.894606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.894927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.895067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.895393 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.895706 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.896021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.896379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.898142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.898506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.898861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.899341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.899548 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.899871 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.900240 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.901568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.901945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.902297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.902631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.902963 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.903287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:18.903543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 09:25:18.966050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Registered counter for database nova_api Jun 04 09:25:18.990262 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.002375 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.096593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 09:25:19.097742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 09:25:19.098041 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 09:25:19.098358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 09:25:19.098627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 09:25:19.099032 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.099366 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.099697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.100028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.100403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.100726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.101066 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.101392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.101730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.102005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.102404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.102653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844695-1-iscsi {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.102983 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.103301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.103621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.103949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.104260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.104620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.104937 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.105469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.105784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.106095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.106412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.106762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.107083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.107442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.107771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.108088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.108466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.108779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.109199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844695-1-iscsi {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.109935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.109935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.110251 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.110567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.110900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.111209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.111538 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.111872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.112187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.112609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.112944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.113466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.113799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.114110 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.114429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.114747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.115076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.115387 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.115700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.115966 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.116123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.context [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),074277cd-5d2b-4eb5-8cdc-e149db967384(cell1) {{(pid=118476) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 09:25:19.116330 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.116637 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.116971 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.117304 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.117569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.117829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.118158 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.118502 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.118872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.119223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.119538 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.119856 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.120167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.120510 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.120827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.121143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.121476 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.121801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.122139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.122461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.122792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.123199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.123461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.123777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.123986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:25:19.124150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.124473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.124993 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.125327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.125658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.125974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.126292 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.126603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.126933 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.127278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.127499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:25:19.127658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.127840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.128195 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.128540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.128869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.129108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:25:19.129287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.129496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.129796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.130185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.130646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.130962 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.131332 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.131595 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.131909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.132226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.132573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.132890 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.133159 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:25:19.133318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.133520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.133848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.134160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.134475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.134794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.135105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.135434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.135750 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.136135 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.136500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.136814 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.136974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Registered counter for database nova_cell0 Jun 04 09:25:19.137122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.137442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.137759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.138073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.138397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.138703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.139015 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.139345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.139657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.139972 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.140278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.140636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.141155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.141335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.141588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.141823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.142333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.142635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.143004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.143281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.143596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.144471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.144800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 09:25:19.145148 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.145490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.145841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.146162 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.146512 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.146675 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Registered counter for database nova_cell1 Jun 04 09:25:19.146828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.147240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.147813 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.148149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.148514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.148836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.149156 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.149483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.149798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.150126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.150568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.150987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.151157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.151405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.151723 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.152048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.152466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.152738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.153328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.153635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.154027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.154373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.154696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.154973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.155268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.155536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.155854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.156185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.156562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.162340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.165906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.166999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.167171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.168643 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.168796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.169096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.170537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.171919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.173326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.173326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.173326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.173326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.173326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.174034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.174034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.174034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.174470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.174614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.175634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.176351 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.176547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.176700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.176949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.177263 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.177578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.177890 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.178228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.178547 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.178866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.179220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.179475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.179756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.179912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.180130 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.180511 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.180861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.181281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.181525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.181876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.182199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.182517 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.182837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.183154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.183474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.183803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.184162 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.184488 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.184812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.185151 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.185470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.185850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.186112 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.186433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.186780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.187137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.187477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.187810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.188130 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.188481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.188806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.189124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.189443 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.189761 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.190088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.190407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.194401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.196876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.198704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.200473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.201768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.201768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.201768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.201768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.202670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.202670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.202670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.203355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.203355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.203827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.203827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.204346 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.204782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.204782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.205240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.205477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.205701 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.205938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.206384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.206883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.207254 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.207492 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.207727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.207936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.208233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.208602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.208920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.209242 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.209553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.209874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.210239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.210959 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.211211 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.211504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.211841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.212348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.212612 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.212879 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.213222 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.213575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.213888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.214208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.214525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.214845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.215153 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.215452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.215774 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.216087 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.216433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.216746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.217216 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.217614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.217847 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.218097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.218345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.218591 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.218878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.219216 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.219533 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.219846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.220156 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.220515 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.220870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.221183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.221532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.221932 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.222277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.222689 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.223150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.223397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.223641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.223874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.224104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.224436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.225090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.225090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.225556 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.225804 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.226038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.226296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.226579 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.226896 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.227380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.227790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.228038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.228383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.228645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.228886 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.229138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.229374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.229683 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.229994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.230318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.230624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.230939 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.231314 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.231564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.231878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.232189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.232555 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.232970 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.233219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.233509 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.233826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.234138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.234451 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.234762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.235237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.235497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.235732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.236024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.236347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.236668 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.236980 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.237296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.238404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.238679 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.238920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.239155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.239564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.239904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.240225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.240572 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.240889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.241199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.241558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.241870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.242241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.242552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.243797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.243797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.243797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.243797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.244527 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.244527 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.245016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.245016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.245609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.245786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.245942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.246253 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.246665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.247151 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.247392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.247672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.248011 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.248642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.248642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.249103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.249325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.249626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.249863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.250174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.250497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.250901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.251312 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.251635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.251951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.252273 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.252641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.252956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.253978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.254226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.254486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.254820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.255095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.255411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.255764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.256225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.256584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.256903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.257407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.257652 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.257874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.258148 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.258475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.258789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.259204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.259522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.259843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.260157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.260514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.261431 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.261431 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.261431 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.262096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.262096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.262529 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.262772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.263067 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.263401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.263841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.264318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.264569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.264915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.265233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.265551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.265913 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.266204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.266535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.266853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.267173 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.267625 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.267872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.268202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.268690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.269148 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.269376 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.269628 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.269874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.270107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.270450 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.270894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.271222 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.271542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.271873 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.272207 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.272973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.273290 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.273650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.273956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.274565 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.274825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.274991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.275269 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.275589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.275905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.276211 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.276552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.276878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.277191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.277529 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.277936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.278164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.278500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.278810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.279259 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.279482 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.279747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.280058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.280404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.280791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.281209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.281483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.281832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.282167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.282486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.282828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.283773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.283773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.283773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.284227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.284883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.284883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.285282 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.285457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.285654 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.285974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.286412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.286673 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.286915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.287396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.287638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.287886 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.288924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.288924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.288924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.289773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.289773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.289773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.290504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.290504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.291077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.291077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.291429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.291678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.292011 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.293140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.293498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.293838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.294166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.294535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.296617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.296617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.297096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.297696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.298457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.298931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.300662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.301140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.301729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.302327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.302925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.303731 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.304355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.305396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.305987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.306589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.307184 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.307801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.308470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.309092 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.309707 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.310301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.310904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.311470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.311813 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.312203 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.312562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.312887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.313215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.313546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.313871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.314196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.314519 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.314870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.316202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.316202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.316833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.316833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.317471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.317471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.317952 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.318209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.318449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.318703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.318985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.319703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.319965 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.320193 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.320553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.320884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.321217 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.321593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.321928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.322237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.322545 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.322866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.323361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.323626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.323846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.324085 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.324420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.324746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.325052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.325630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.325982 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.326300 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.326631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.326966 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.327342 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.327649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.327976 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.328441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.328671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.328992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.329298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.329605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.329916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.330225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.330537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.330843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.331185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.331497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.331837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.332142 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.332487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.332878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.333200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.333509 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.333815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.334119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.334423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.334744 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.335050 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.335362 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.335668 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.335975 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.336279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.336616 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.336972 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.337334 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.337715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.337898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.338212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.338525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.338898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.339276 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.339594 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.339947 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.340331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.340910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.341245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.341571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.341921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.342256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.342570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.342676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO dbcounter [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Registered counter for database nova_cell0 Jun 04 09:25:19.342880 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.343195 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.343521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.343835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.344145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.344561 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.344990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.345309 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.345621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.346097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.346241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.346539 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.346888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.347200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.347516 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.347822 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.348144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.348527 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.348858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.349177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.349490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.349811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.350120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.350433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.350622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.350745 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.351031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.351342 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.351679 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.351992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.352340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.352819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.353212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.353447 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.353768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.354079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.354402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.354724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.355033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.355358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.355668 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.355999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.356368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.356590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writer thread running {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.356829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.357037 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.357315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.357624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.357927 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.358238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.358559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.358872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.359301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.359613 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.359928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.360236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.360602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.360860 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.361229 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.361548 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.361852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.362154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.363021 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.363328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.363635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.363938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.364248 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.364578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.364884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.365185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.365491 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.365791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.366133 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.366578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.366786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.367204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.367471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.367866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.368179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.368528 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.368853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.369170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.369483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.369814 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.370124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.370437 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.370748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.371055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.371363 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.371672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.372002 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.372350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.372661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.372986 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.373346 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.373672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.373985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.374294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.374623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.374937 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.375270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.375584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.375894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.376317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.376766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.376947 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.377270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.377597 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.377910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.378844 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.379217 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.379572 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.379890 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.380446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.380779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.381097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.381483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.381717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 09:25:19.381963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 09:25:19.444459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Registered counter for database nova_api Jun 04 09:25:19.467266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.476059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.537799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.context [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),074277cd-5d2b-4eb5-8cdc-e149db967384(cell1) {{(pid=118477) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 09:25:19.542343 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:25:19.544022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:25:19.544994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:25:19.547132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:25:19.549328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Registered counter for database nova_cell0 Jun 04 09:25:19.554823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Registered counter for database nova_cell1 Jun 04 09:25:19.564863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.566465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.573903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.575296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.740408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO dbcounter [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Registered counter for database nova_cell0 Jun 04 09:25:19.749684 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_db.sqlalchemy.engines [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 09:25:19.756119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writer thread running {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 09:25:19.817326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:25:19.824904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:25:20.071062 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:25:20.081536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: WARNING keystonemiddleware.auth_token [None req-9cb9a416-ad11-4acf-a530-bb7ec69d5b48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:25:20.090301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558e056949c0 pid: 118476 (default app) Jun 04 09:25:20.210800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:25:20.218625 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:25:20.462339 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 09:25:20.468800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: WARNING keystonemiddleware.auth_token [None req-934760f7-8f8b-474c-8670-de5523c61356 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 09:25:20.474467 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558e056949c0 pid: 118477 (default app) Jun 04 09:26:08.623712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:08.626656 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:08.628663 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:08.629961 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:10.442759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7b417a2c-b05f-4d4c-8c10-e7b5ff45e4df tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Action: 'create', calling method: .version_select at 0x7fa417d8e5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-253077982"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:13.331989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7b417a2c-b05f-4d4c-8c10-e7b5ff45e4df tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.731177 Jun 04 09:26:13.333879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Sat Jun 4 09:26:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4736 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 04 09:26:13.664432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1092891526", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "networks": [{"uuid": "f519e47e-a808-4b8b-856c-a7ef5c2f4cd7"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:13.880409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f66ec7f5-2768-4e42-b2eb-51f7244d6427 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417e70280>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:13.909821 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] validate_networks() for [('f519e47e-a808-4b8b-856c-a7ef5c2f4cd7', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:13.915834 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:13.916891 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:13.918299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:13.919378 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:14.396001 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f66ec7f5-2768-4e42-b2eb-51f7244d6427 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 200 len: 344 microversion: 2.1 time: 1.046968 Jun 04 09:26:14.397533 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:13 2022] GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 344 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:15.094611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:15.095777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:15.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:15.097544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:15.098043 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:15.114964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:15.116161 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:15.117048 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:15.117702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:15.155819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Getting quotas for project 29bb9979415948f685ad1fe8d58bfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:15.163827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Getting quotas for user c1a0478618b1430b9c8c609618257eca and project 29bb9979415948f685ad1fe8d58bfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:15.181475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:15.184579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:15.416322 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0c58d5ea-0a4c-414b-b508-9e6ed4befdf7 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417c4d8b0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:15.504215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e5d020e5-7a62-4002-bb66-8ec9a91ee089 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.980428 Jun 04 09:26:15.511178 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:26:15.518529 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fadad1a2-65db-4484-af72-7e04ccc40799 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:15.519176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fadad1a2-65db-4484-af72-7e04ccc40799 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:15.553031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0c58d5ea-0a4c-414b-b508-9e6ed4befdf7 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 200 len: 345 microversion: 2.1 time: 0.143034 Jun 04 09:26:15.554803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:15 2022] GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:26:15.574415 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1740fa16-5c17-40b4-a972-e2fd941633d1 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Action: 'create', calling method: .version_select at 0x7fa417c4daf0>, body: {"snapshot": {"volume_id": "bac06f42-6255-4284-8d6c-aa8a91c5d016", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-561120346"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:15.673577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fadad1a2-65db-4484-af72-7e04ccc40799 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:15.727163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fadad1a2-65db-4484-af72-7e04ccc40799 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1215 microversion: 2.1 time: 0.212291 Jun 04 09:26:15.727831 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:15 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:16.748670 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b91fecf9-0fe6-45b3-a522-54366ede5e5d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:16.750333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b91fecf9-0fe6-45b3-a522-54366ede5e5d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:16.893912 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b91fecf9-0fe6-45b3-a522-54366ede5e5d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:16.911142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b91fecf9-0fe6-45b3-a522-54366ede5e5d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1215 microversion: 2.1 time: 0.166574 Jun 04 09:26:16.912266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 4/6] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:16 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:16.969297 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1740fa16-5c17-40b4-a972-e2fd941633d1 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.401845 Jun 04 09:26:16.970322 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 3/7] 10.222.0.46 () {60 vars in 1161 bytes} [Sat Jun 4 09:26:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:16.983167 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0fd4c6e4-a6c0-42be-b8e3-03d51d2fe24e tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa416b22dc0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:17.367875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0fd4c6e4-a6c0-42be-b8e3-03d51d2fe24e tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 286 microversion: 2.1 time: 0.388477 Jun 04 09:26:17.369459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 5/8] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:16 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 286 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:17.379671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e3ea2d1-5e6c-49ab-8f43-76d9f750d7da tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417c155e0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:17.614014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e3ea2d1-5e6c-49ab-8f43-76d9f750d7da tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.238827 Jun 04 09:26:17.615375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 4/9] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jun 4 09:26:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:17.627545 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9fb1f807-fe18-4464-84b9-f7bfc1b870bd tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa416b2c430>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:17.833766 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9fb1f807-fe18-4464-84b9-f7bfc1b870bd tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 286 microversion: 2.1 time: 0.211632 Jun 04 09:26:17.835986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 6/10] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:17 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 286 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:26:17.929078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ce067841-84a6-439f-89e6-fb10ba97af43 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:17.929913 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ce067841-84a6-439f-89e6-fb10ba97af43 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:18.062631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ce067841-84a6-439f-89e6-fb10ba97af43 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:18.081830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ce067841-84a6-439f-89e6-fb10ba97af43 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1215 microversion: 2.1 time: 0.157194 Jun 04 09:26:18.085458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 5/11] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:17 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:18.849080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6aa46bf1-daee-4048-b4ea-f271e9f6e815 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa416b22d30>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:18.990311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6aa46bf1-daee-4048-b4ea-f271e9f6e815 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 286 microversion: 2.1 time: 0.146844 Jun 04 09:26:18.995955 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:18 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:26:19.107742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:19.112631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:19.137244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:19.141154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:19.142937 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:19.143749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:19.427090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:19.450924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a5d7f534-c670-4143-8085-1d6d4775254c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1219 microversion: 2.1 time: 0.351774 Jun 04 09:26:19.453112 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 6/13] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:19 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1219 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:20.007720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf7fd5b2-75e7-4b91-adc3-990021c7ec3c tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa416b223a0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:20.078131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bf7fd5b2-75e7-4b91-adc3-990021c7ec3c tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 286 microversion: 2.1 time: 0.077912 Jun 04 09:26:20.081812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 8/14] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:19 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:20.478655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:20.480506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:20.498715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:20.499584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:20.500740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:20.501695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:20.640753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:20.651964 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-95c5537d-9141-496f-88a1-b386f090d741 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1219 microversion: 2.1 time: 0.177964 Jun 04 09:26:20.656126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 7/15] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:20 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:21.094890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2f66732c-4c5a-4858-9277-8b1acce84ee2 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b713a0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:21.190231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2f66732c-4c5a-4858-9277-8b1acce84ee2 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 287 microversion: 2.1 time: 0.098869 Jun 04 09:26:21.201671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 9/16] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:21 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:21.211557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-291f3014-52dd-4b11-a2c1-dc636f2962b5 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b61550>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:21.615331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-291f3014-52dd-4b11-a2c1-dc636f2962b5 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 202 len: 0 microversion: 2.1 time: 0.411002 Jun 04 09:26:21.621559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 8/17] 10.222.0.46 () {58 vars in 1253 bytes} [Sat Jun 4 09:26:21 2022] DELETE /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:26:21.630688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f3c8f798-9cee-49b1-8f3a-1a73b6f28410 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa416b2c280>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:21.683812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:21.688067 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:21.715023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:21.718187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:21.724870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f3c8f798-9cee-49b1-8f3a-1a73b6f28410 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 200 len: 286 microversion: 2.1 time: 0.100566 Jun 04 09:26:21.727063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:21.730535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:21.732634 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:21 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:22.168680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:22.198526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3035f40d-27ec-44f7-983f-659c72782073 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1211 microversion: 2.1 time: 0.522260 Jun 04 09:26:22.202469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 9/19] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:21 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1211 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:22.740249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c33abd54-1ab4-4a1b-8bd5-661ff59c17e8 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417c59b80>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:23.085548 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-c33abd54-1ab4-4a1b-8bd5-661ff59c17e8 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] HTTP exception thrown: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c33abd54-1ab4-4a1b-8bd5-661ff59c17e8 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Request method failure captured: Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a HTTP/1.1 Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyUwT7pzczgdmUVvLSLlvuTWzCCMXwW5PdIezCSfBBYIvyqdnnYRsxmjXOIx-34Lno97x5n0a8_V31nHx9AU-uwgHE3jypQnUEi5huqF9v56pQA3zOrYCbPDhCx56ke6jHZ0V2Y9syiiDbunAjgl4uaF_VUGhjHEwgz2ze_vxtqZumU Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:26:23.091490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_64e9b1acaed94e648a8c2debe67bee7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 2059259463264cab9e1b7da51a61a6cc Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'd4c1a451-7fce-4abe-8752-21f1d72d6e7a'} Jun 04 09:26:23.095019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. (HTTP 404) (Request-ID: req-3e5b7766-13e1-4b89-bec8-ade6d48336b2) Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.096534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:23.099330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 04 09:26:23.103200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c33abd54-1ab4-4a1b-8bd5-661ff59c17e8 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Returning 404 to user: Snapshot d4c1a451-7fce-4abe-8752-21f1d72d6e7a could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:23.108833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c33abd54-1ab4-4a1b-8bd5-661ff59c17e8 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a" status: 404 len: 111 microversion: 2.1 time: 0.365466 Jun 04 09:26:23.110313 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Jun 4 09:26:22 2022] GET /compute/v2.1/os-snapshots/d4c1a451-7fce-4abe-8752-21f1d72d6e7a => generated 111 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:26:23.116135 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-98946b44-8ef3-4d0d-ae0f-3bdb30069500 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b619d0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:23.236981 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:23.238072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:23.313830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:23.314592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:23.323409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:23.326813 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:23.730439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-98946b44-8ef3-4d0d-ae0f-3bdb30069500 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 202 len: 0 microversion: 2.1 time: 0.620643 Jun 04 09:26:23.731854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:26:23 2022] DELETE /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:26:23.744829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a1313918-a0bd-47bc-84f6-4150d34f25f9 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b61670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:23.850285 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:23.874024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-90f8fd7b-2fa0-4478-87fe-b4def56d55bf tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1275 microversion: 2.1 time: 0.645525 Jun 04 09:26:23.874550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:23 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1275 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:23.925201 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a1313918-a0bd-47bc-84f6-4150d34f25f9 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 200 len: 344 microversion: 2.1 time: 0.186659 Jun 04 09:26:23.928648 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:23 2022] GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:24.917578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:24.923147 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:24.944154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bbe1839e-4185-47f0-a17a-03553dc17b18 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b56790>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:24.985918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:24.990972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:24.997544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:24.998434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:25.015616 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-bbe1839e-4185-47f0-a17a-03553dc17b18 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] HTTP exception thrown: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bbe1839e-4185-47f0-a17a-03553dc17b18 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Request method failure captured: Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 HTTP/1.1 Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyUwT7pzczgdmUVvLSLlvuTWzCCMXwW5PdIezCSfBBYIvyqdnnYRsxmjXOIx-34Lno97x5n0a8_V31nHx9AU-uwgHE3jypQnUEi5huqF9v56pQA3zOrYCbPDhCx56ke6jHZ0V2Y9syiiDbunAjgl4uaF_VUGhjHEwgz2ze_vxtqZumU Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:25.017987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_64e9b1acaed94e648a8c2debe67bee7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 2059259463264cab9e1b7da51a61a6cc Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'bac06f42-6255-4284-8d6c-aa8a91c5d016'} Jun 04 09:26:25.019081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. (HTTP 404) (Request-ID: req-d94616ec-de8e-459a-8719-f649c75d1439) Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.019742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:25.021199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 09:26:25.022106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.022974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.025530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bbe1839e-4185-47f0-a17a-03553dc17b18 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Returning 404 to user: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:25.026421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bbe1839e-4185-47f0-a17a-03553dc17b18 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 404 len: 109 microversion: 2.1 time: 0.086574 Jun 04 09:26:25.030239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:24 2022] GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:26:25.049689 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36bdf79d-0a4e-4a8e-a387-80804d8c4f68 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b76160>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:25.134388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-36bdf79d-0a4e-4a8e-a387-80804d8c4f68 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] HTTP exception thrown: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36bdf79d-0a4e-4a8e-a387-80804d8c4f68 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Request method failure captured: Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 HTTP/1.1 Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyUwT7pzczgdmUVvLSLlvuTWzCCMXwW5PdIezCSfBBYIvyqdnnYRsxmjXOIx-34Lno97x5n0a8_V31nHx9AU-uwgHE3jypQnUEi5huqF9v56pQA3zOrYCbPDhCx56ke6jHZ0V2Y9syiiDbunAjgl4uaF_VUGhjHEwgz2ze_vxtqZumU Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:25.136833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_64e9b1acaed94e648a8c2debe67bee7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 2059259463264cab9e1b7da51a61a6cc Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'bac06f42-6255-4284-8d6c-aa8a91c5d016'} Jun 04 09:26:25.137994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. (HTTP 404) (Request-ID: req-2a256bd3-b1cc-4ce4-b307-4b5dc81e49f3) Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.138627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:25.139518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 09:26:25.141582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.143025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.145657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36bdf79d-0a4e-4a8e-a387-80804d8c4f68 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Returning 404 to user: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:25.146796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-36bdf79d-0a4e-4a8e-a387-80804d8c4f68 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 404 len: 109 microversion: 2.1 time: 0.109899 Jun 04 09:26:25.147674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:26:25 2022] DELETE /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:26:25.162642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc94e409-5eee-4a9d-b2d8-a01398e56949 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Calling method '.version_select at 0x7fa417b614c0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:25.167747 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:25.253777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-dc94e409-5eee-4a9d-b2d8-a01398e56949 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] HTTP exception thrown: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc94e409-5eee-4a9d-b2d8-a01398e56949 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Request method failure captured: Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 HTTP/1.1 Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyUwT7pzczgdmUVvLSLlvuTWzCCMXwW5PdIezCSfBBYIvyqdnnYRsxmjXOIx-34Lno97x5n0a8_V31nHx9AU-uwgHE3jypQnUEi5huqF9v56pQA3zOrYCbPDhCx56ke6jHZ0V2Y9syiiDbunAjgl4uaF_VUGhjHEwgz2ze_vxtqZumU Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:25.256969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_64e9b1acaed94e648a8c2debe67bee7c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/64e9b1acaed94e648a8c2debe67bee7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 64e9b1acaed94e648a8c2debe67bee7c Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1430387588 Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 2059259463264cab9e1b7da51a61a6cc Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1430387588-project Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'bac06f42-6255-4284-8d6c-aa8a91c5d016'} Jun 04 09:26:25.258122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. (HTTP 404) (Request-ID: req-f575709a-ba8d-425e-b293-3746c84b2f78) Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.259704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:25.260650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 09:26:25.262080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. Jun 04 09:26:25.264730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:25.267986 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc94e409-5eee-4a9d-b2d8-a01398e56949 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] Returning 404 to user: Volume bac06f42-6255-4284-8d6c-aa8a91c5d016 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:25.269221 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dc94e409-5eee-4a9d-b2d8-a01398e56949 tempest-VolumesSnapshotsTestJSON-1430387588 tempest-VolumesSnapshotsTestJSON-1430387588-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016" status: 404 len: 109 microversion: 2.1 time: 0.115381 Jun 04 09:26:25.270687 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 14/26] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:25 2022] GET /compute/v2.1/os-volumes/bac06f42-6255-4284-8d6c-aa8a91c5d016 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:26:26.050128 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:26.066286 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b15bcd6c-04ea-4931-9646-d557e6ade812 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1273 microversion: 2.1 time: 1.171663 Jun 04 09:26:26.080191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:24 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1273 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:27.087845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:27.088706 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:27.144824 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:27.147826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:27.155691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:27.156957 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:28.084754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:28.101481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:28.118969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-06e8c2e0-a3d3-49a1-b91a-3a70267fc78b tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1273 microversion: 2.1 time: 1.036203 Jun 04 09:26:28.120232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:27 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1273 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:29.076272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:29.138773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:29.141316 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:29.156918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:29.158155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:29.159496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:29.164598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:30.227568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d8c49f4-9e15-4603-add0-548ea38c27eb tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: .version_select at 0x7fa416a3d9d0>, body: {"keypair": {"name": "tempest-keypair-627886981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOGNB9uaWvKFaQslPlojfF/+H6Wc+dF/IEBp9i/bRlAFBTYliTT6Ch8wyVD9seN4xpu8EEVpunm6AAmgOt67h1EBSY9V+gO04HIALwlnMILn6lBtJHhjmL9BxoIZf821Q=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:30.347659 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-9d8c49f4-9e15-4603-add0-548ea38c27eb tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for project e27e8df485ff405e965cf22847c3b262. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:30.354163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-9d8c49f4-9e15-4603-add0-548ea38c27eb tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for user ac869ff528aa49989c88b3a545ba9cf1 and project e27e8df485ff405e965cf22847c3b262. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:30.587562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d8c49f4-9e15-4603-add0-548ea38c27eb tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.517267 Jun 04 09:26:30.587562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 14/29] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:26:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:26:31.231784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:31.282865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4aa54c49-e391-4aa5-a3aa-ea2241833767 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 2.141758 Jun 04 09:26:31.282865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 16/30] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:29 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:31.827535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2089870642", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:32.083096 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] validate_networks() for [('440b27b7-eea1-406f-839f-e25bf291973d', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:32.300311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:32.302396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:32.316458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:32.317523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:32.318907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:32.320317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:33.675363 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:33.701543 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-893b315c-ae9e-4ac3-8848-d474119041e8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 1.402853 Jun 04 09:26:33.704306 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 17/31] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:32 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:35.394427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7132ab32-8851-4ce7-80c6-19d42687afe3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: .version_select at 0x7fa417b76160>, body: {"keypair": {"name": "tempest-keypair-787807369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINN1Hc2vmkNZO3Gh2dClHUeUypc+VhyDZP+vpV4a8Zy+ykvtTW24ZKEqSRoCMrMvGD9dFvgDZwdIK/ZAUUr05nKhhXWYWkwl83OU5G42c9YQqbKolPriKUv7w6deM4YDg=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:35.546677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-7132ab32-8851-4ce7-80c6-19d42687afe3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for project 0cf07261800e47938626f61a1fb73b2b. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:35.575481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-7132ab32-8851-4ce7-80c6-19d42687afe3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for user 7b6676edfa984008b846589b2df9ef92 and project 0cf07261800e47938626f61a1fb73b2b. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:35.961066 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7132ab32-8851-4ce7-80c6-19d42687afe3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 2.001075 Jun 04 09:26:35.962143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 18/32] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Jun 4 09:26:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 2003 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 04 09:26:35.985481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:35.992428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:36.017962 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:36.018417 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:36.019259 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:36.019709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:36.057396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=14 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:36.254974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:36.255454 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:36.256007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:36.256507 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:36.257322 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:36.310118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:36.324984 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:36.328077 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:36.328845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:36.398519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:36.413033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for user 34a7ef6d33b141ce8fb1cec517faffd1 and project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:36.452948 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:36.457102 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:36.852688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7d891c6b-d1e7-4101-92a6-376139022791 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.446223 Jun 04 09:26:36.859215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 15/33] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:26:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 5482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:26:38.276229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-478347ff-5bb1-44b7-b2d3-5deb4970d373 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Action: 'create', calling method: .version_select at 0x7fa416a3d550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1329092697", "metadata": {"Type": "work"}}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-478347ff-5bb1-44b7-b2d3-5deb4970d373 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 122 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:26:38.302633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1329092697", "metadata": {"Type": "work"}}} Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: Jun 04 09:26:38.303823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1329092697', 'metadata': {'Type': 'work'}}}} Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise error Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi '#$%' Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:38.305064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 09:26:38.306284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 09:26:38.308309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 09:26:38.308309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.309714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-478347ff-5bb1-44b7-b2d3-5deb4970d373 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:38.310920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-478347ff-5bb1-44b7-b2d3-5deb4970d373 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.450685 Jun 04 09:26:38.312109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 16/34] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jun 4 09:26:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1452 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:26:38.352066 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c726c57a-f764-4897-913f-d7a93ff0d55d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:38.352066 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c726c57a-f764-4897-913f-d7a93ff0d55d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:38.669154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:38.682086 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23824f49-0798-4ed9-9dd8-243c008c2a39 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 2.718289 Jun 04 09:26:38.686285 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:35 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:38.693380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6165b80b-057b-4d9e-bbd2-9e98470c1ad2 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Action: 'create', calling method: .version_select at 0x7fa417aa9f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-712514858", "metadata": {"Type": "work"}}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6165b80b-057b-4d9e-bbd2-9e98470c1ad2 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 119 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:38.708743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-712514858", "metadata": {"Type": "work"}}} Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:38.710636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-712514858', 'metadata': {'Type': 'work'}}}} Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise error Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi '0' Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:38.711397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 09:26:38.712531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 09:26:38.713513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 09:26:38.713513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.716651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6165b80b-057b-4d9e-bbd2-9e98470c1ad2 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:38.720434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6165b80b-057b-4d9e-bbd2-9e98470c1ad2 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032559 Jun 04 09:26:38.721308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 20/36] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jun 4 09:26:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:26:38.736987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fe55b66-443d-40fb-a097-9a2a931a7478 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Action: 'create', calling method: .version_select at 0x7fa417a845e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982135109", "metadata": {"Type": "work"}}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fe55b66-443d-40fb-a097-9a2a931a7478 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 119 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:38.739995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1982135109", "metadata": {"Type": "work"}}} Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:38.741658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982135109', 'metadata': {'Type': 'work'}}}} Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise error Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi '' Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:38.743185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 09:26:38.744855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 09:26:38.747048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 09:26:38.747048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.755564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fe55b66-443d-40fb-a097-9a2a931a7478 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:38.761657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7fe55b66-443d-40fb-a097-9a2a931a7478 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029083 Jun 04 09:26:38.762786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 21/37] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jun 4 09:26:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 09:26:38.781630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f4fce42f-f791-4c6b-b68f-db4cda9de473 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Calling method '.version_select at 0x7fa41722aaf0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:38.785463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c726c57a-f764-4897-913f-d7a93ff0d55d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:38.797183 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c726c57a-f764-4897-913f-d7a93ff0d55d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1222 microversion: 2.1 time: 0.483150 Jun 04 09:26:38.797782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 17/38] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:38 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1222 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:38.960239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-f4fce42f-f791-4c6b-b68f-db4cda9de473 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] HTTP exception thrown: Volume tempest-invalid-451979679 could not be found. Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f4fce42f-f791-4c6b-b68f-db4cda9de473 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-451979679 HTTP/1.1 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:26:38.962900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Volume tempest-invalid-451979679 could not be found. Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'tempest-invalid-451979679'} Jun 04 09:26:38.964380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-451979679 could not be found. (HTTP 404) (Request-ID: req-a8f6e961-b17e-48b6-b0cc-5bb8f2ddb4c8) Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.965372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:38.966568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-451979679 could not be found. Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:38.967837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-451979679 could not be found. Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-451979679 could not be found. Jun 04 09:26:38.969191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:26:38.973325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f4fce42f-f791-4c6b-b68f-db4cda9de473 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 404 to user: Volume tempest-invalid-451979679 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:38.974754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f4fce42f-f791-4c6b-b68f-db4cda9de473 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-451979679" status: 404 len: 98 microversion: 2.1 time: 0.200084 Jun 04 09:26:38.975818 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 22/39] 10.222.0.46 () {58 vars in 1214 bytes} [Sat Jun 4 09:26:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-451979679 => generated 98 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 09:26:38.988370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-99dc40b6-6cad-496d-8c0b-6b1ef4e4de82 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004466 Jun 04 09:26:38.989348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 18/40] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Jun 4 09:26:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 09:26:39.003098 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9d3da415-03a5-4976-a937-54b2d866d753 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006101 Jun 04 09:26:39.007198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 23/41] 10.222.0.46 () {58 vars in 1136 bytes} [Sat Jun 4 09:26:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 04 09:26:39.023879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6608485b-4be9-4ac1-b826-5e8e7fa2764a tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Calling method '.version_select at 0x7fa416a2a1f0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:39.160149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2070156466", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:39.174345 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-6608485b-4be9-4ac1-b826-5e8e7fa2764a tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] HTTP exception thrown: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6608485b-4be9-4ac1-b826-5e8e7fa2764a tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/os-volumes/8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 HTTP/1.1 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:26:39.177835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '8909e7bb-4463-49a7-ac3b-c7cdaf28cd66'} Jun 04 09:26:39.179274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. (HTTP 404) (Request-ID: req-60128ed7-4d05-41c3-8ee2-12d49f2e47e3) Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.180061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 09:26:39.181347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 09:26:39.182578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. Jun 04 09:26:39.183985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.186057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6608485b-4be9-4ac1-b826-5e8e7fa2764a tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 404 to user: Volume 8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:39.186439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6608485b-4be9-4ac1-b826-5e8e7fa2764a tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/8909e7bb-4463-49a7-ac3b-c7cdaf28cd66" status: 404 len: 109 microversion: 2.1 time: 0.171927 Jun 04 09:26:39.192712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 19/42] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:26:39 2022] DELETE /compute/v2.1/os-volumes/8909e7bb-4463-49a7-ac3b-c7cdaf28cd66 => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:26:39.232411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ccecea85-ceff-44d6-a3fb-ee85e27c1834 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Calling method '.version_select at 0x7fa41699d8b0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:39.335539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-ccecea85-ceff-44d6-a3fb-ee85e27c1834 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] HTTP exception thrown: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ccecea85-ceff-44d6-a3fb-ee85e27c1834 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Request method failure captured: Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/os-volumes/8fe49e1e-3168-4e8c-8ccc-afe7477bc9da HTTP/1.1 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVLFd5kACNshk_vQCDQa3xN5RkcLrVU3N0aaY1POdPLpbwoVG5cvPjcZkTGS-isXRWwpjQe_QGjHVF94go4eM5Yz4UwsJTfjWSG5uaheabLHdFoC5hBMVKSH5wE92lK1ShgLsf_oXnC3C2OR2_A0n004bTKHhphm0sFCgu_QGmh8Qo Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:26:39.339324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d9f10bade7f942dfb6deaec35c6fd9c0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d9f10bade7f942dfb6deaec35c6fd9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: d9f10bade7f942dfb6deaec35c6fd9c0 Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-696342362 Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: d76295c1980544a4b41c20c6ef7d8157 Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-696342362-project Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '8fe49e1e-3168-4e8c-8ccc-afe7477bc9da'} Jun 04 09:26:39.340582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. (HTTP 404) (Request-ID: req-03d82faf-ee0c-4d4b-8077-9b59bd884e68) Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.341371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:26:39.342471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 09:26:39.343636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ccecea85-ceff-44d6-a3fb-ee85e27c1834 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] Returning 404 to user: Volume 8fe49e1e-3168-4e8c-8ccc-afe7477bc9da could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:26:39.347109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ccecea85-ceff-44d6-a3fb-ee85e27c1834 tempest-VolumesNegativeTest-696342362 tempest-VolumesNegativeTest-696342362-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8fe49e1e-3168-4e8c-8ccc-afe7477bc9da" status: 404 len: 109 microversion: 2.1 time: 0.135883 Jun 04 09:26:39.354164 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:26:39 2022] GET /compute/v2.1/os-volumes/8fe49e1e-3168-4e8c-8ccc-afe7477bc9da => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:26:39.435000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] validate_networks() for [('440b27b7-eea1-406f-839f-e25bf291973d', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:39.706869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:39.707833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:39.716525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:39.724579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:39.725256 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:39.726318 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:39.726962 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:41.005230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:41.015434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1a727c32-0d98-46f3-9468-5f8d3d83119c tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 1.316258 Jun 04 09:26:41.031290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 21/44] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:39 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:41.648596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-63125ff9-7197-497d-857e-389e04d9a2ed tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: .version_select at 0x7fa4169d8280>, body: {"keypair": {"name": "tempest-keypair-601581030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvFvhWzNlocRu5+kv5oqVm6UFHTggqeKpk/IRD6s1LNxJ7K3sh31pokYPltcxfTu3YQg/XvZ+5ws0z+rizN6IZ2X3cFbd8mvUUaWNLUCj5rghVleK6Ej4WSJZ6mNRTpzQ=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:41.792463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-63125ff9-7197-497d-857e-389e04d9a2ed tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:41.813559 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-63125ff9-7197-497d-857e-389e04d9a2ed tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:42.055847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-63125ff9-7197-497d-857e-389e04d9a2ed tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.022446 Jun 04 09:26:42.057712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:26:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:42.265559 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-dbe39747-3c94-425b-bf6e-51ad1760d1df req-11984cc1-c0d1-4eaf-ada4-c443c9681221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5b1685-7f08-4537-99c6-95643dd6a29e", "tag": "7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:42.330014 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-dbe39747-3c94-425b-bf6e-51ad1760d1df req-11984cc1-c0d1-4eaf-ada4-c443c9681221 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:42.336169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-dbe39747-3c94-425b-bf6e-51ad1760d1df req-11984cc1-c0d1-4eaf-ada4-c443c9681221 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:42.407249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-dbe39747-3c94-425b-bf6e-51ad1760d1df req-11984cc1-c0d1-4eaf-ada4-c443c9681221 service nova] Creating event network-changed:7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa for instance 6a5b1685-7f08-4537-99c6-95643dd6a29e on hv-cinder-84469 Jun 04 09:26:42.411839 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-dbe39747-3c94-425b-bf6e-51ad1760d1df req-11984cc1-c0d1-4eaf-ada4-c443c9681221 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 09:26:42.415540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:42.421802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:42.423597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:42.425689 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:42.466586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.compute.rpcapi [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 09:26:42.482031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 09:26:42.546960 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-49159b12-f18c-49e5-ade2-9cfcdc5112b5 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483758 Jun 04 09:26:42.548696 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 23/46] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:42.583992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:42.585146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:42.605911 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:42.606395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:42.609834 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:42.610383 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:44.664132 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:44.665915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:44.665915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:44.665915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:44.665915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:44.665915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:44.666954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-357c469d-0c34-4182-a0af-58b0c6865abb tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 2.058141 Jun 04 09:26:44.666954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 24/47] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:42 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:44.667095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:44.667095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:44.667095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:44.667095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:44.694159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:44.736403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for user 34a7ef6d33b141ce8fb1cec517faffd1 and project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:44.756048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:44.759639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:45.118103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-907209939", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a96e2986-096a-4e28-a2fd-b426bbfcf78d"}], "security_groups": [{"name": "tempest-securitygroup--355866160"}], "key_name": "tempest-keypair-787807369", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:45.370724 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] validate_networks() for [('a96e2986-096a-4e28-a2fd-b426bbfcf78d', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:45.943754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:45.944624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:45.945523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:45.946233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:45.946993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:45.963565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:45.964106 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:45.965253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:45.965858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:45.996343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for project 0cf07261800e47938626f61a1fb73b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:46.008358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for user 7b6676edfa984008b846589b2df9ef92 and project 0cf07261800e47938626f61a1fb73b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:46.024250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:46.026805 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:46.574684 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-be047a32-e79d-44b6-ac7a-f879ea179838 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.421025 Jun 04 09:26:46.576198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 24/48] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:26:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 7424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:26:46.582988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:46.584479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:46.587309 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:46.594165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:46.594839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:46.596068 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:46.596692 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:46.601328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=45 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:46.735397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1e160f33-447e-43c2-b38d-e6e4f84637d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.625216 Jun 04 09:26:46.740011 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 25/49] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jun 4 09:26:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 09:26:46.748828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a40d5f8b-a878-4fe1-a27d-08e34f3f1a32 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:46.750972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a40d5f8b-a878-4fe1-a27d-08e34f3f1a32 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:46.953050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a40d5f8b-a878-4fe1-a27d-08e34f3f1a32 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:46.968342 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a40d5f8b-a878-4fe1-a27d-08e34f3f1a32 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1222 microversion: 2.1 time: 0.223473 Jun 04 09:26:46.969592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 26/50] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:46 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:46.980145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:46.980145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:47.160874 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:47.174574 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:47.180386 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:47.186839 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-809a0454-9aca-4821-9ef0-0debd5ef4eb4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1280 microversion: 2.20 time: 0.209516 Jun 04 09:26:47.231263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 27/51] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:46 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1280 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:47.233073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:47.243826 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1455127765", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30b7bf35-2401-45dc-8576-04df5c21df11"}], "security_groups": [{"name": "tempest-securitygroup--1724940686"}], "key_name": "tempest-keypair-627886981", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:47.267454 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-069d42fc-de79-4aa0-a513-096649bfd746 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 0.667419 Jun 04 09:26:47.271949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 25/52] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:46 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:47.859829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] validate_networks() for [('30b7bf35-2401-45dc-8576-04df5c21df11', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:47.994153 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d4aa7983-3aa4-4221-908a-114fe589efd6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:48.008035 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d4aa7983-3aa4-4221-908a-114fe589efd6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:48.567607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d4aa7983-3aa4-4221-908a-114fe589efd6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:48.585380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d4aa7983-3aa4-4221-908a-114fe589efd6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1222 microversion: 2.1 time: 0.601026 Jun 04 09:26:48.590488 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 26/53] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:47 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1222 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:48.600574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:48.602431 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:48.747887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:48.768346 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:48.772310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:48.776122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-08047320-1fab-4d4b-a1ed-3bc3c27ec11e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1280 microversion: 2.20 time: 0.183194 Jun 04 09:26:48.778036 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 27/54] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:48 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:48.789034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:48.791372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:48.804088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:48.804862 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:48.806697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:48.807343 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:49.730836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:49.741405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-275235a2-9845-49fb-b0f9-96caaa5ad6c6 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 0.961413 Jun 04 09:26:49.742525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 28/55] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:48 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:49.749633 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:49.750651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:49.763669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:49.765775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:49.766829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:49.767618 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:49.912803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:49.923411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3f01ba97-0410-4c1b-aeea-30241c0bf374 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1226 microversion: 2.1 time: 0.178667 Jun 04 09:26:49.925333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 29/56] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:49 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1226 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:49.932798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:49.933703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:49.945792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:49.946266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:49.947866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:49.948503 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.129803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:50.159805 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:50.165991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:50.177264 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d9632329-7837-4db0-902e-a274af14770c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1284 microversion: 2.20 time: 0.246269 Jun 04 09:26:50.184619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 30/57] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:49 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:50.236852 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:50.238284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:50.238725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:50.239687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:50.240738 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:50.303702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.312552 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.315918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.321586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.398978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for project e27e8df485ff405e965cf22847c3b262. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:50.409129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for user ac869ff528aa49989c88b3a545ba9cf1 and project e27e8df485ff405e965cf22847c3b262. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:50.453944 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:50.458140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:50.763226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:50.764557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:50.771625 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9a023ef4-9efc-4725-817d-5752a27bf9b7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.567094 Jun 04 09:26:50.772208 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 28/58] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:26:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:26:50.785524 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7d3b9401-b8f6-4eaf-b815-9e17ad9614b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:50.786202 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7d3b9401-b8f6-4eaf-b815-9e17ad9614b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:50.795286 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.799500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.801007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.801558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.894745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7d3b9401-b8f6-4eaf-b815-9e17ad9614b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:50.902544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7d3b9401-b8f6-4eaf-b815-9e17ad9614b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1237 microversion: 2.1 time: 0.120887 Jun 04 09:26:50.903473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 29/59] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:50 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:50.944447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:50.945227 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:50.961748 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.962817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:50.963887 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:50.964549 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:51.289070 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:51.308952 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ade5525f-7545-4954-a587-5fae5335e811 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1218 microversion: 2.1 time: 0.365895 Jun 04 09:26:51.311042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 30/60] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:50 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1218 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:51.324338 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:51.326251 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:51.345913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:51.347374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:51.349612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:51.350749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:51.548688 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:51.572033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:51.596540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:51.596540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:51.596916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e41002de-cce6-47f2-97d1-47237308a66d tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 0.828914 Jun 04 09:26:51.597059 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-33205944-69af-4840-ae39-5d10664478d4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1332 microversion: 2.20 time: 0.272732 Jun 04 09:26:51.597059 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:51 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1332 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:51.608266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 31/62] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:50 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:51.936840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e0860918-b04c-4b79-bbd6-53c3ff84507c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:51.938388 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e0860918-b04c-4b79-bbd6-53c3ff84507c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:52.075946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e0860918-b04c-4b79-bbd6-53c3ff84507c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:52.095309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e0860918-b04c-4b79-bbd6-53c3ff84507c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1237 microversion: 2.1 time: 0.166333 Jun 04 09:26:52.107260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:51 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:52.344946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:52.346533 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:52.408854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:52.410001 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:52.411444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:52.412204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:52.451047 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-178443179", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72d5f400-ff54-4f35-902d-3289af4496b7"}], "security_groups": [{"name": "tempest-securitygroup--1567026051"}], "key_name": "tempest-keypair-601581030", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:52.740537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:52.777064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-267a7085-c59a-4a95-bdcd-59e485bd168b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1282 microversion: 2.1 time: 0.440135 Jun 04 09:26:52.784639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 32/64] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:52 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1282 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:52.794435 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:52.834330 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:52.860797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:52.860797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:52.865919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:52.867203 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:52.902542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] validate_networks() for [('72d5f400-ff54-4f35-902d-3289af4496b7', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:26:53.295520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:53.323434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:53.333730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:53.343225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a7d17cb8-1cd9-464d-b27c-0e9e3b81ffce tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1340 microversion: 2.20 time: 0.555971 Jun 04 09:26:53.344423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:52 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1340 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:53.381161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:53.383764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:53.402491 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:53.403566 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:53.406212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:53.407759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:53.987408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:53.999661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b9072c4b-21c5-4776-950c-41ca07fd1504 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 0.653430 Jun 04 09:26:54.019647 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 34/66] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:53 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:54.019647 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:54.026598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:54.042009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.042481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.043291 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.043842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.220238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:54.243314 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-211dbd66-17ef-4123-9558-e1deafa47f13 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1233 microversion: 2.1 time: 0.234435 Jun 04 09:26:54.248312 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 35/67] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:54 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1233 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:54.269002 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:54.270328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:54.282733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.283606 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.285680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.286471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.347129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:26:54.347906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:26:54.348800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:26:54.349730 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:26:54.350391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:26:54.386134 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.389395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.394238 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.397275 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.435307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:26:54.443706 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:26:54.466469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:54.467111 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:26:54.471395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:26:54.481528 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-842cb9c3-8a8f-404b-a8e8-5f27f7e19519 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1280 microversion: 2.1 time: 0.229433 Jun 04 09:26:54.483911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 36/68] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:54 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:54.581291 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e0ac374f-6b2e-4cb4-a32d-e6838ae5da70 req-01701e42-efda-4d82-a1af-7d388bdeab45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4", "tag": "c2a78627-a21d-4c75-b1ec-12a456b91ec2"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:54.627419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e0ac374f-6b2e-4cb4-a32d-e6838ae5da70 req-01701e42-efda-4d82-a1af-7d388bdeab45 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.628259 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e0ac374f-6b2e-4cb4-a32d-e6838ae5da70 req-01701e42-efda-4d82-a1af-7d388bdeab45 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.680682 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:54.683771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e0ac374f-6b2e-4cb4-a32d-e6838ae5da70 req-01701e42-efda-4d82-a1af-7d388bdeab45 service nova] Creating event network-changed:c2a78627-a21d-4c75-b1ec-12a456b91ec2 for instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 on hv-cinder-84469 Jun 04 09:26:54.684499 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e0ac374f-6b2e-4cb4-a32d-e6838ae5da70 req-01701e42-efda-4d82-a1af-7d388bdeab45 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 09:26:54.686112 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.688019 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.689161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.689863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.701746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.compute.rpcapi [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 09:26:54.703099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] Releasing lock "compute-rpcapi-router" {{(pid=118477) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 09:26:54.714541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ee7bddb1-f906-4e57-a1d5-403c8dea3491 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.274069 Jun 04 09:26:54.725205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 33/69] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:26:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:26:54.737819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-149a2502-3b8c-44da-8b6a-0be805b6c72e None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251724 Jun 04 09:26:54.739070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 37/70] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:54.746614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e0b2b6df-c1ef-4198-999d-65f238238ed2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:54.747369 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:54.748142 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e0b2b6df-c1ef-4198-999d-65f238238ed2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:54.755616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:54.826329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.828592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.830556 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:54.832864 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:54.914370 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e0b2b6df-c1ef-4198-999d-65f238238ed2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:54.933249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e0b2b6df-c1ef-4198-999d-65f238238ed2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1240 microversion: 2.1 time: 0.191767 Jun 04 09:26:54.934134 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 38/71] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:54 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1240 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:55.038598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:55.044506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:55.074379 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.078241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.083361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.092406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.126795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:55.139301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:55.151091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:55.151867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-53f85532-ea33-489d-86a7-3ba0218ec852 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1338 microversion: 2.20 time: 0.422976 Jun 04 09:26:55.153308 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 34/72] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:54 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1338 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:55.264512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:55.265559 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:55.273953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.274423 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.280951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.280951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.676327 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:55.688219 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9537eada-d6da-44b1-a099-94a709cbe711 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1297 microversion: 2.1 time: 0.427146 Jun 04 09:26:55.688980 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 35/73] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:55 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1297 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:55.706326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:55.706968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:55.732764 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.735794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.740141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.740753 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.745143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:55.756838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4417919b-ddc0-4ff4-9139-cff350fd83be tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 0.724096 Jun 04 09:26:55.758703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 39/74] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:55 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:55.962676 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-159dc5c2-c5c8-4ede-af06-5c2730f2fe45 req-6b5a7073-b139-4aea-a95e-36caeebde91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5b1685-7f08-4537-99c6-95643dd6a29e", "name": "network-vif-plugged", "status": "completed", "tag": "7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:26:55.973250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-159dc5c2-c5c8-4ede-af06-5c2730f2fe45 req-6b5a7073-b139-4aea-a95e-36caeebde91e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:55.973704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-159dc5c2-c5c8-4ede-af06-5c2730f2fe45 req-6b5a7073-b139-4aea-a95e-36caeebde91e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:55.992412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-159dc5c2-c5c8-4ede-af06-5c2730f2fe45 req-6b5a7073-b139-4aea-a95e-36caeebde91e service nova] Creating event network-vif-plugged:7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa for instance 6a5b1685-7f08-4537-99c6-95643dd6a29e on hv-cinder-84469 Jun 04 09:26:56.006436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-159dc5c2-c5c8-4ede-af06-5c2730f2fe45 req-6b5a7073-b139-4aea-a95e-36caeebde91e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237661 Jun 04 09:26:56.007786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 40/75] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:26:56.017725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-18e6974e-c15f-4d8f-9098-059742d8c050 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:56.018938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-18e6974e-c15f-4d8f-9098-059742d8c050 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:56.377141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18e6974e-c15f-4d8f-9098-059742d8c050 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:56.386177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-18e6974e-c15f-4d8f-9098-059742d8c050 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1240 microversion: 2.1 time: 0.376362 Jun 04 09:26:56.387402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 41/76] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:56 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1240 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:56.392885 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:56.393808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:56.400862 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.401550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:56.403062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.403777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:56.534234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:56.545749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:56.548237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:56.550115 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-937a87f8-b301-4ebe-90f3-913ca5719f78 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1338 microversion: 2.20 time: 0.161253 Jun 04 09:26:56.551301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 42/77] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:56 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:56.557172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:56.576507 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-677c5e6e-664f-4e2d-a7b8-aae5c61ceb01 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.883385 Jun 04 09:26:56.578482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 36/78] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:55 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:56.724678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:56.732198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:56.752203 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.757093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:56.758414 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.759219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:56.781719 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:56.784253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:56.814051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.815514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:56.821335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:56.831932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:57.194872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:57.223825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-82adc5df-493b-4b4a-8f6a-665a34f137cf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1295 microversion: 2.1 time: 0.509343 Jun 04 09:26:57.235762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 43/79] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:56 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1295 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:57.403809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:57.405311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:57.423696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:57.424442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:57.425835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:57.428554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:57.828268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:57.855077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-81e37d9f-5ff6-4021-aabf-acb0d0c542d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1244 microversion: 2.1 time: 0.454749 Jun 04 09:26:57.856487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 44/80] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:57 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1244 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:26:57.865106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:57.881723 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:57.901924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:57.903039 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:57.905574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:57.911434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:57.994721 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:58.010501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf0bbc8a-f535-4057-995f-c52b9cf84e84 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 1.238559 Jun 04 09:26:58.012277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 37/81] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:56 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:58.020647 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:58.034637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:58.034637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:58.034637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.035603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:58.037191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.038098 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:58.687478 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:58.698160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-622d18aa-3f12-4f33-bf64-b3acbd02794a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.684188 Jun 04 09:26:58.699074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 38/82] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:58 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:58.704743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:58.709637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:58.721517 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.722176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:58.723157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.723817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:58.835939 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:58.872539 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:58.884053 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:58.885548 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ccf8be47-693d-4436-bfc0-c21633a3f460 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 1.027328 Jun 04 09:26:58.890665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 45/83] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:26:57 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:26:58.898274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:58.901919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:58.943139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.943601 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:58.944468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:58.945113 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:59.094306 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:59.105415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1ae17265-aa2c-4801-abb9-6461cc59ef87 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1295 microversion: 2.1 time: 0.405043 Jun 04 09:26:59.108488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 39/84] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:58 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1295 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:59.124001 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:59.135105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:59.159431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:59.161174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:59.162038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:59.162467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:59.231909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:26:59.246960 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:26:59.264897 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5cb7a142-d001-43fd-9e33-fd84ba3b1e05 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1292 microversion: 2.1 time: 0.372529 Jun 04 09:26:59.268373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 46/85] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:58 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1292 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:26:59.736907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:26:59.736907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:26:59.741675 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:59.742655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:26:59.743711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:26:59.744613 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.237049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:00.297571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a5d86fd4-e3d6-410a-842d-126d5af375a8 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1315 microversion: 2.1 time: 1.187644 Jun 04 09:27:00.326575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 40/86] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:59 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1315 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:00.362018 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-c817d2b6-427b-481a-b0f0-8cbe1715077d req-0551eedb-5b0b-48d9-87b2-88d66cadd6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:00.399829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c817d2b6-427b-481a-b0f0-8cbe1715077d req-0551eedb-5b0b-48d9-87b2-88d66cadd6db service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.402896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c817d2b6-427b-481a-b0f0-8cbe1715077d req-0551eedb-5b0b-48d9-87b2-88d66cadd6db service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.407782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:00.420576 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-be1c73cc-c961-4864-bea7-fc5af3bed649 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.692796 Jun 04 09:27:00.425905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 47/87] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:26:59 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:00.431186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:00.445381 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:00.467813 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.470582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.471780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.472981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.479133 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-c817d2b6-427b-481a-b0f0-8cbe1715077d req-0551eedb-5b0b-48d9-87b2-88d66cadd6db service nova] Creating event network-changed:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:27:00.503752 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-c817d2b6-427b-481a-b0f0-8cbe1715077d req-0551eedb-5b0b-48d9-87b2-88d66cadd6db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163324 Jun 04 09:27:00.508525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 41/88] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:00.530427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:00.532108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:00.546067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.557446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.557446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.557446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.810810 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:00.832772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9ec72e8e-7826-4023-ae4a-1227c10377dd tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1295 microversion: 2.1 time: 0.312538 Jun 04 09:27:00.832772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 42/89] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:00 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1295 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:00.847966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:00.848870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:00.861430 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.866540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:00.866540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:00.866540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:01.261141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:01.309737 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:01.314900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:01.317361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1146efaf-62c2-44c8-a7b5-ea0fed8c3173 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 0.889723 Jun 04 09:27:01.319614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 48/90] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:00 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:01.357483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-9e2df255-06e5-4c29-a034-9366274299bc req-79914e94-569d-48e1-8b35-8382049c81f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92f8d5f8-9053-432b-918a-3c3b59143d88", "tag": "98695bf0-7d62-4518-9f4c-0adc21e6836d"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:01.401586 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9e2df255-06e5-4c29-a034-9366274299bc req-79914e94-569d-48e1-8b35-8382049c81f6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:01.403590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9e2df255-06e5-4c29-a034-9366274299bc req-79914e94-569d-48e1-8b35-8382049c81f6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:01.454720 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-9e2df255-06e5-4c29-a034-9366274299bc req-79914e94-569d-48e1-8b35-8382049c81f6 service nova] Creating event network-changed:98695bf0-7d62-4518-9f4c-0adc21e6836d for instance 92f8d5f8-9053-432b-918a-3c3b59143d88 on hv-cinder-84469 Jun 04 09:27:01.478745 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-9e2df255-06e5-4c29-a034-9366274299bc req-79914e94-569d-48e1-8b35-8382049c81f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156793 Jun 04 09:27:01.484687 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 49/91] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:01.510231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:01.511574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:01.528034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:01.529159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:01.532997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:01.536680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.079885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.097928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8065328c-6446-4a81-8752-7d73b2b61213 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1298 microversion: 2.1 time: 1.263040 Jun 04 09:27:02.098806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 43/92] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:00 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1298 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:02.106216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:02.107921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:02.118249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.119118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.120118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.122114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.386530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.405398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6272a52f-276c-4440-bcb2-e89aa4a31c24 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1502 microversion: 2.1 time: 0.918005 Jun 04 09:27:02.406992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 50/93] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:01 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1502 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:02.416569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:02.418146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:02.436769 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.437946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.439120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.439768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.606904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.620570 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b80ac60d-e9e0-4486-8a6d-ccff47059ccf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.519494 Jun 04 09:27:02.621901 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 44/94] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:02 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:02.630302 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:02.631781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:02.650402 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.650995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.651900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.652536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.660578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:02.802352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.812458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5f237b94-240f-4684-82ae-544445f11235 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.403668 Jun 04 09:27:02.813060 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 51/95] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:02 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:02.818061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-4514521c-f40c-4e37-8613-8d144f9b00b4 req-e132d3be-bea5-463f-8eba-647175f494d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4", "name": "network-vif-plugged", "status": "completed", "tag": "c2a78627-a21d-4c75-b1ec-12a456b91ec2"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:02.839064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4514521c-f40c-4e37-8613-8d144f9b00b4 req-e132d3be-bea5-463f-8eba-647175f494d1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:02.839846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4514521c-f40c-4e37-8613-8d144f9b00b4 req-e132d3be-bea5-463f-8eba-647175f494d1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:02.863039 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-4514521c-f40c-4e37-8613-8d144f9b00b4 req-e132d3be-bea5-463f-8eba-647175f494d1 service nova] Creating event network-vif-plugged:c2a78627-a21d-4c75-b1ec-12a456b91ec2 for instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 on hv-cinder-84469 Jun 04 09:27:02.874395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-4514521c-f40c-4e37-8613-8d144f9b00b4 req-e132d3be-bea5-463f-8eba-647175f494d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058408 Jun 04 09:27:02.877060 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 52/96] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:02.961509 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.987256 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.992830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:02.994421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c756132f-ec77-4fda-b899-dec9e750a869 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 0.370028 Jun 04 09:27:03.009918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 45/97] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:02 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:03.127462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:03.128555 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:03.148075 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.152267 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:03.152267 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.152267 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:03.433951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:03.449155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e2d491ea-9ed2-47ce-ae26-c63c0890564d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1298 microversion: 2.1 time: 0.328761 Jun 04 09:27:03.452148 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 53/98] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:03 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1298 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:03.644397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:03.644397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:03.654199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.654686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:03.655552 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.655933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:03.837295 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:03.840540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:03.861469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.862585 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:03.864131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:03.865011 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:04.398854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:04.418585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:04.432078 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ecc1f994-31de-4742-b2b7-27b78a091974 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.791106 Jun 04 09:27:04.435882 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 46/99] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:03 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:04.445539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:04.447145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:04.457712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:04.458473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:04.459621 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:04.461053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:04.461813 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=42 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:04.519183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:04.543044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b56a4082-13bd-418c-9a0b-fa81c6560b12 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.710416 Jun 04 09:27:04.553884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 54/100] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:03 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:04.553884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:04.564539 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:04.575924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:04.577213 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:04.578264 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:04.578927 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:05.402620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:05.443450 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:05.448975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:05.455049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-98312eb9-bf37-41d4-a69c-2f3e94df9477 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 1.014258 Jun 04 09:27:05.463169 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:05.472319 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e491e3a7-5118-483f-9526-88474a94701f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.925608 Jun 04 09:27:05.487801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 55/102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:04 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:05.488802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 47/102] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:04 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:05.497116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c73568e-d5bc-43a7-8c2a-5b0d1e923043"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:05.498018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:05.512150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:05.513204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:05.513778 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:05.513997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:05.514624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:05.515183 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:05.534601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:05.534601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:05.536622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:05.537872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:06.083921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:06.172873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:06.180687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5facc01b-7a40-4f82-8a9a-a933d3c540d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.681754 Jun 04 09:27:06.181278 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 48/103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:05 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:06.195676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:06.196329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:06.203632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:06.204074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:06.205114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:06.205562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:06.382343 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=18 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:06.536723 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:06.555706 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f6d0a647-09e6-4704-a169-a220a9e7ef43 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.363487 Jun 04 09:27:06.557932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 49/104] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:06 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:06.586268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:06.587431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:06.601565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:06.603641 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:06.605403 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:06.607415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.312601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:07.321802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-acec1467-2fd5-4db8-8a29-1a66673d58e4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.754478 Jun 04 09:27:07.335795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 50/105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:06 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:07.345273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:07.349417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:07.361951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.367191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.368272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.369918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.550974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e3594e23-1bf5-42fc-9769-8cc011106439 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "POST /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.067917 Jun 04 09:27:07.559409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 56/106] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:27:05 2022] POST /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e/os-volume_attachments => generated 194 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:07.559409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-554eda41-d52e-4634-b4a1-ef18a74d633f req-aa19d43d-e8b9-4598-9f7f-1735e0930b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffde7de1-13e8-4ea6-98d2-d07a19afee2e", "tag": "19828924-fa28-4424-9220-6e59b86934bf"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:07.578614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-554eda41-d52e-4634-b4a1-ef18a74d633f req-aa19d43d-e8b9-4598-9f7f-1735e0930b4d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.579073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-554eda41-d52e-4634-b4a1-ef18a74d633f req-aa19d43d-e8b9-4598-9f7f-1735e0930b4d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.594097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-554eda41-d52e-4634-b4a1-ef18a74d633f req-aa19d43d-e8b9-4598-9f7f-1735e0930b4d service nova] Creating event network-changed:19828924-fa28-4424-9220-6e59b86934bf for instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e on hv-cinder-84469 Jun 04 09:27:07.599910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-554eda41-d52e-4634-b4a1-ef18a74d633f req-aa19d43d-e8b9-4598-9f7f-1735e0930b4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047115 Jun 04 09:27:07.601621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 57/107] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:07.609725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:07.610700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:07.619856 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.620764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.622009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.622630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.874597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:07.891033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:07.895944 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:07.916598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-93ce020f-202b-48a3-82e5-95f48e709ff3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 0.560979 Jun 04 09:27:07.916598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 51/108] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:07 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:07.918537 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:07.919173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:07.926008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.926895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.927971 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:07.928455 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:07.969651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:07.983145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bee9d494-7c5c-435f-8ccb-d46693859366 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.379416 Jun 04 09:27:07.984627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 58/109] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:07 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:08.341715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:08.342352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:08.366344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:08.371183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:08.380176 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:08.384449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:08.533979 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:08.552387 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05be24c8-fff5-43b4-9bd9-d40ce81c9492 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.642179 Jun 04 09:27:08.563291 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 52/110] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:07 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:08.917833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-8dea92d5-562c-424c-8ba1-39626cf517e2 req-3d9a725d-e380-42f4-9e8b-c2a6ef2080f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:08.953928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-8dea92d5-562c-424c-8ba1-39626cf517e2 req-3d9a725d-e380-42f4-9e8b-c2a6ef2080f1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:08.961613 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-8dea92d5-562c-424c-8ba1-39626cf517e2 req-3d9a725d-e380-42f4-9e8b-c2a6ef2080f1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.011827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-8dea92d5-562c-424c-8ba1-39626cf517e2 req-3d9a725d-e380-42f4-9e8b-c2a6ef2080f1 service nova] Creating event network-vif-plugged:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:27:09.031767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-8dea92d5-562c-424c-8ba1-39626cf517e2 req-3d9a725d-e380-42f4-9e8b-c2a6ef2080f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119162 Jun 04 09:27:09.031767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 53/111] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:27:09.050846 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:09.052203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:09.072063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.073073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.074676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.075709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.360415 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.368610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e736a136-b4b2-43a6-9062-670d9f52d359 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 1.030627 Jun 04 09:27:09.377494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 59/112] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:08 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:09.386494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:09.387409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:09.398248 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.398408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.400044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.401123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.497557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.547557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.557363 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.562044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e712925d-74fe-413a-a40d-31e735d18fe7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 0.531138 Jun 04 09:27:09.566891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 54/113] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:09 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:09.616120 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:09.630927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:09.630927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.632762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.634690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.635829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.653120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.663282 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6400fa3c-9d6c-4b1b-9afa-a73460e25cdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.281289 Jun 04 09:27:09.663890 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 60/114] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:09 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:09.669550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-05ed6bd3-f6b6-4f05-8b8f-ebe8b1050cc4 req-ed4b6d3e-c851-4a6c-ad4c-e2e3860a8eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c900d7-98de-4ba9-a6d7-98bc2194c582", "tag": "edfbce93-3cd9-4178-ab5b-64cba09aa8ad"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:09.679163 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-05ed6bd3-f6b6-4f05-8b8f-ebe8b1050cc4 req-ed4b6d3e-c851-4a6c-ad4c-e2e3860a8eec service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:09.679866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-05ed6bd3-f6b6-4f05-8b8f-ebe8b1050cc4 req-ed4b6d3e-c851-4a6c-ad4c-e2e3860a8eec service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:09.694908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-05ed6bd3-f6b6-4f05-8b8f-ebe8b1050cc4 req-ed4b6d3e-c851-4a6c-ad4c-e2e3860a8eec service nova] Creating event network-changed:edfbce93-3cd9-4178-ab5b-64cba09aa8ad for instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 on hv-cinder-84469 Jun 04 09:27:09.700641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-05ed6bd3-f6b6-4f05-8b8f-ebe8b1050cc4 req-ed4b6d3e-c851-4a6c-ad4c-e2e3860a8eec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033766 Jun 04 09:27:09.701428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 61/115] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:09.807376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:09.819745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a29afde6-7929-4562-8ee5-8c06d01a7575 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.212614 Jun 04 09:27:09.820909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 55/116] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:09 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:10.388021 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:10.389295 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:10.396967 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.397489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:10.403093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.403093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:10.606979 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:10.609063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:10.618845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:10.635871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f7663268-da56-44d9-b9fe-c60005b9bd01 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.252910 Jun 04 09:27:10.637712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 62/117] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:10 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:10.657646 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.658873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:10.660480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.661535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:10.694730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:10.695620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:10.702536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.705912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:10.705912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:10.705912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.159934 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:11.175367 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:11.177088 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:11.178290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1a25b746-46f4-452c-a731-593cd8860371 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1405 microversion: 2.20 time: 0.583327 Jun 04 09:27:11.178872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 56/118] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:10 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:11.199410 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:11.199410 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:11.218153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:11.218900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.219860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:11.220486 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.235729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:11.277844 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-064af174-811c-4940-9769-1e1c9442394a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.592440 Jun 04 09:27:11.281676 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 63/119] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:10 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:11.292164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-878fce6c-a338-44fb-ab54-7b4f2a2f778e req-4b0956fb-b31d-44b1-be5c-b33028f7fa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f8d5f8-9053-432b-918a-3c3b59143d88", "name": "network-vif-plugged", "status": "completed", "tag": "98695bf0-7d62-4518-9f4c-0adc21e6836d"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:11.316871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-878fce6c-a338-44fb-ab54-7b4f2a2f778e req-4b0956fb-b31d-44b1-be5c-b33028f7fa8b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:11.319765 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-878fce6c-a338-44fb-ab54-7b4f2a2f778e req-4b0956fb-b31d-44b1-be5c-b33028f7fa8b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.346704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-878fce6c-a338-44fb-ab54-7b4f2a2f778e req-4b0956fb-b31d-44b1-be5c-b33028f7fa8b service nova] Creating event network-vif-plugged:98695bf0-7d62-4518-9f4c-0adc21e6836d for instance 92f8d5f8-9053-432b-918a-3c3b59143d88 on hv-cinder-84469 Jun 04 09:27:11.358487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-878fce6c-a338-44fb-ab54-7b4f2a2f778e req-4b0956fb-b31d-44b1-be5c-b33028f7fa8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074517 Jun 04 09:27:11.360038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 64/120] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:11.681361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:11.681955 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:11.697205 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:11.698022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.699529 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:11.700536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:11.722448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:11.733580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:11.748468 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a628453d-8ac0-4c2e-a817-3d73ec69a6b0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.561477 Jun 04 09:27:11.751556 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 57/121] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:11 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:12.213864 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:12.214652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:12.224131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.224821 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.225759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.226479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.528983 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:12.559832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-efe380a9-6c78-4bdb-ac07-93783e4e515f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.898329 Jun 04 09:27:12.561479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 65/122] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:11 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:12.595382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:12.607391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:12.629620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.630058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.631240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.631429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.772456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:12.787778 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:12.791334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:12.802505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a7833b09-b9b7-4751-a5b7-59cc68d7a086 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1597 microversion: 2.20 time: 0.587754 Jun 04 09:27:12.809177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 58/123] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:27:12 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1597 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:27:12.834554 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:12.834554 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:12.853066 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.853848 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.855986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.856652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.934944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:12.947574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f51ef96e-d9f4-4fae-ac0a-709f43b07ecf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.383875 Jun 04 09:27:12.949098 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 66/124] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:12 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:12.978189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:12.979286 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:12.993344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.994496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:12.997078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:12.998550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:13.257215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fcf297b5-a343-4a2f-b308-283d97325fb0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.293919 Jun 04 09:27:13.264246 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 67/125] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jun 4 09:27:12 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:27:13.273781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:13.283929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-51018cd1-a5ff-474c-ab10-c6f752558cd3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.460703 Jun 04 09:27:13.285161 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 59/126] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:12 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:13.580425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:13.581249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:13.599058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:13.599876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:13.601014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:13.602071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:13.977185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:13.977932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:13.982026 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:13.997511 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-862669fb-5022-401c-907d-c579b1931f32 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.421881 Jun 04 09:27:14.012400 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:14.012847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:14.013657 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:14.014208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 68/127] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:13 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:14.021998 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:14.302725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:14.304125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:14.318048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:14.319850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:14.320788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:14.321237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:14.391137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:14.399734 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b4fd162e-c458-4133-a8b0-e21dd9cbddb1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.426667 Jun 04 09:27:14.404770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 60/128] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:13 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:14.634410 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:14.647446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-52f0df00-ccba-4cd5-8c50-dd201c0da1ac tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.348613 Jun 04 09:27:14.648218 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 69/129] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:14 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:14.735674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ebb3dc2b-cebe-48f8-909b-049f1ef1a002 req-e1b56b9c-b4af-43ac-9778-dafafd66284b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffde7de1-13e8-4ea6-98d2-d07a19afee2e", "name": "network-vif-plugged", "status": "completed", "tag": "19828924-fa28-4424-9220-6e59b86934bf"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:14.748136 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ebb3dc2b-cebe-48f8-909b-049f1ef1a002 req-e1b56b9c-b4af-43ac-9778-dafafd66284b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:14.748693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ebb3dc2b-cebe-48f8-909b-049f1ef1a002 req-e1b56b9c-b4af-43ac-9778-dafafd66284b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:14.762764 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ebb3dc2b-cebe-48f8-909b-049f1ef1a002 req-e1b56b9c-b4af-43ac-9778-dafafd66284b service nova] Creating event network-vif-plugged:19828924-fa28-4424-9220-6e59b86934bf for instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e on hv-cinder-84469 Jun 04 09:27:14.769420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ebb3dc2b-cebe-48f8-909b-049f1ef1a002 req-e1b56b9c-b4af-43ac-9778-dafafd66284b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Jun 04 09:27:14.770319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 61/130] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:15.023609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:15.024936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:15.039851 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.041161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.044199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.045324 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.419587 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:15.420690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:15.422789 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:15.428014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b23ac801-b320-40a5-bc7a-f5342904b09c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.414823 Jun 04 09:27:15.429484 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 70/131] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:15 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:15.441440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.443107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.444003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.445082 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.594908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-189e0057-683d-4890-8d2d-c9db3bc02dea req-5b711a4b-8557-40cb-aaab-37a3700929f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:15.608550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:15.612401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-189e0057-683d-4890-8d2d-c9db3bc02dea req-5b711a4b-8557-40cb-aaab-37a3700929f3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.612819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-189e0057-683d-4890-8d2d-c9db3bc02dea req-5b711a4b-8557-40cb-aaab-37a3700929f3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.686480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:15.703993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dfac2b9e-dc83-445d-b14e-962cae5da078 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.288169 Jun 04 09:27:15.705499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 62/132] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:15 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:15.715298 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:15.716781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:15.728113 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.729249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.730999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:15.731688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:15.760240 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:15.791812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-189e0057-683d-4890-8d2d-c9db3bc02dea req-5b711a4b-8557-40cb-aaab-37a3700929f3 service nova] Creating event network-changed:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:27:15.806321 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-189e0057-683d-4890-8d2d-c9db3bc02dea req-5b711a4b-8557-40cb-aaab-37a3700929f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213417 Jun 04 09:27:15.806321 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 71/133] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:27:15.968646 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:15.978184 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-36666318-5300-4be6-9462-89daddd77176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.270507 Jun 04 09:27:15.978947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 63/134] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:15 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:16.452949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:16.461556 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:16.505042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:16.519894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:16.527899 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:16.531973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:16.739955 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:16.741817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:16.752034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:16.752596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:16.753615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:16.754050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:16.914587 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:16.934170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-01217fd8-ddf2-41b1-8eb6-81d34a8bc37f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.488572 Jun 04 09:27:16.935459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 72/135] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:16 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:17.162992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:17.162992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43200cd6-43fb-4c41-b899-a670cbf8ec1d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1322 microversion: 2.1 time: 0.251021 Jun 04 09:27:17.162992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 64/136] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:16 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:17.168140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:17.168140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:17.168140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:17.168140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:17.168764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:17.168764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:17.422262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:17.430479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-80bf61ec-2506-4dbc-a0e6-f5857855e5ed tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.437068 Jun 04 09:27:17.431111 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 73/137] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:16 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:17.958051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:17.958802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:17.971135 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:17.971586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:17.972565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:17.973007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.181839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:18.183936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:18.196731 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.198283 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.198969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.201065 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.224160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:18.233150 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b8c91377-c103-4668-8cef-4fabb376f7cf tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.280393 Jun 04 09:27:18.233735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 65/138] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:17 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:18.412076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:18.420666 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-813299db-db28-45d6-893d-678f8c9db866 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1516 microversion: 2.1 time: 0.247211 Jun 04 09:27:18.421459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 74/139] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:18 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:18.444577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:18.446872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:18.463632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.464585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.464781 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:18.465938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.466843 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.467293 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:18.484795 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.485421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.487388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:18.489406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:18.588593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'flavor' on Instance uuid 92f8d5f8-9053-432b-918a-3c3b59143d88 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:27:18.750120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:18.758559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f3fee48a-7e47-49f1-bcd7-750950bcf4a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.305505 Jun 04 09:27:18.759572 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 75/140] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:18 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:19.045911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:19.045911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:19.049479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.049978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.051466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.051920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.087394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:27:19.181472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cdcb073d-5a9d-4fb6-a565-f2e96dffcc77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88/action" status: 200 len: 32 microversion: 2.1 time: 0.744918 Jun 04 09:27:19.186339 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 66/141] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:27:18 2022] POST /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88/action => generated 32 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 09:27:19.206192 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:19.207390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:19.223582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.229918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.229918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.229918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.443680 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:19.453354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eefe9076-f58a-4e8b-b8a8-6019d25394dd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.259104 Jun 04 09:27:19.454038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 67/142] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:19 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:19.463353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:19.465318 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:19.475420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.476115 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.477079 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.477626 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.587279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0b848b45-7403-4ee2-b7cd-a857b883dffa tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 204 len: 0 microversion: 2.1 time: 0.549320 Jun 04 09:27:19.588491 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 76/143] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:27:19 2022] DELETE /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:27:19.616872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-ded23634-1cef-4a31-b024-73c96a1a1066 req-4a8cbf84-a363-4c2e-971b-f7a91eaf11dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c900d7-98de-4ba9-a6d7-98bc2194c582", "name": "network-vif-plugged", "status": "completed", "tag": "edfbce93-3cd9-4178-ab5b-64cba09aa8ad"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:19.646454 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ded23634-1cef-4a31-b024-73c96a1a1066 req-4a8cbf84-a363-4c2e-971b-f7a91eaf11dc service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.649749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ded23634-1cef-4a31-b024-73c96a1a1066 req-4a8cbf84-a363-4c2e-971b-f7a91eaf11dc service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.676557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-ded23634-1cef-4a31-b024-73c96a1a1066 req-4a8cbf84-a363-4c2e-971b-f7a91eaf11dc service nova] Creating event network-vif-plugged:edfbce93-3cd9-4178-ab5b-64cba09aa8ad for instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 on hv-cinder-84469 Jun 04 09:27:19.687395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-ded23634-1cef-4a31-b024-73c96a1a1066 req-4a8cbf84-a363-4c2e-971b-f7a91eaf11dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095932 Jun 04 09:27:19.688852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 77/144] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:19.699020 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:19.700878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:19.716006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.716724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.718144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.718885 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.746408 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:19.763904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1da15561-b2e9-4c73-bb25-d4c399da90c5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.307856 Jun 04 09:27:19.764923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 68/145] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:19 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:19.786735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:19.790902 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:19.801203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.802017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:19.803394 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:19.804252 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:20.299692 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:20.315703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:20.316538 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ea7e8eda-147d-4730-8daa-07e940684949 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1554 microversion: 2.1 time: 0.625687 Jun 04 09:27:20.324413 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 78/146] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:19 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1554 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:20.329000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-61f90ed0-8069-4aa0-a143-f2edb3f977af tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1363 microversion: 2.1 time: 0.549577 Jun 04 09:27:20.331729 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 69/147] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:19 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:20.484859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:20.485973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:20.498123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:20.509287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:20.509287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:20.509287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:20.696956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:20.707117 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-39f3e631-ff2d-4b2a-a736-9fceda5159a7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.230171 Jun 04 09:27:20.707710 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 79/148] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:20 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:20.792522 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:20.793057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:20.800151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:20.800514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:20.801323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:20.801767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:20.978226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:20.983649 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b0b93e08-b8a1-43f5-ba05-61a30d454b6b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.196141 Jun 04 09:27:20.984242 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 70/149] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:20 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:21.350978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:21.351607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:21.359962 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:21.361535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:21.369983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.370578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.371173 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.371500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.371979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.372085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.373615 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.374967 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.757918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:21.774028 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c030bf41-5d53-43c7-b7dc-409d52f58ee1 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1554 microversion: 2.1 time: 0.420082 Jun 04 09:27:21.775116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 71/150] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:21 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:21.784573 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:21.785333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:21.795487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:21.796907 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.797835 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.799640 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.800898 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.802951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ea5de97-7da2-452c-b628-330597de7ce2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1549 microversion: 2.1 time: 0.455827 Jun 04 09:27:21.803552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 80/151] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:21 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1549 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:21.834835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:21.840006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:21.847793 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.849062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:21.850433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:21.851184 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:22.041390 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3d956ca7-9a14-4316-bfa3-e42519f8bf42 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213932 Jun 04 09:27:22.042023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 81/152] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:27:21 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:22.056278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:22.056278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:22.059107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:22.059901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:22.061338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:22.062089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:22.097660 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:22.106477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:22.125412 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ff74af8c-657c-479b-84a4-b8ca076ed97a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.348171 Jun 04 09:27:22.126770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 72/153] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:21 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:22.334948 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:22.354282 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9bddb068-e762-457d-a6f1-a851f30f2ef3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.310601 Jun 04 09:27:22.355919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 82/154] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:22 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:22.801520 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:22.802678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:22.816487 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:22.817409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:22.818886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:22.819667 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.159738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:23.160886 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:23.175194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:23.175950 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.177375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:23.178478 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.340447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:23.358563 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dbf92d69-0314-4166-a2e0-aea5ec0cfebe tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1554 microversion: 2.1 time: 0.564777 Jun 04 09:27:23.360062 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 73/155] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:22 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1554 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:23.379817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:23.382691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:23.388875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:23.390102 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.394248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:23.395044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.746766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:23.795309 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e39abee2-d23f-469c-b0cf-5673e2aad955 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.645134 Jun 04 09:27:23.797827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 83/156] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:23 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:23.819995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-30d4d2d6-9806-454e-bec3-0b302327493f req-8d3d2aa7-82af-4851-a2ab-780d2b1e1027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffde7de1-13e8-4ea6-98d2-d07a19afee2e", "tag": "19828924-fa28-4424-9220-6e59b86934bf"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:23.840765 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-30d4d2d6-9806-454e-bec3-0b302327493f req-8d3d2aa7-82af-4851-a2ab-780d2b1e1027 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:23.842305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-30d4d2d6-9806-454e-bec3-0b302327493f req-8d3d2aa7-82af-4851-a2ab-780d2b1e1027 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:23.860847 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-30d4d2d6-9806-454e-bec3-0b302327493f req-8d3d2aa7-82af-4851-a2ab-780d2b1e1027 service nova] Creating event network-changed:19828924-fa28-4424-9220-6e59b86934bf for instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e on hv-cinder-84469 Jun 04 09:27:23.867817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-30d4d2d6-9806-454e-bec3-0b302327493f req-8d3d2aa7-82af-4851-a2ab-780d2b1e1027 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065492 Jun 04 09:27:23.870997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 84/157] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:24.283016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:24.324060 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-345f6bf1-ec70-4009-bdf3-49e25d0be4b1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1366 microversion: 2.1 time: 0.951446 Jun 04 09:27:24.326650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 74/158] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:23 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1366 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:24.395602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:24.397339 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:24.412240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:24.413590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:24.415564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:24.418281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:24.831540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:24.833734 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:24.847259 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:24.848086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:24.849592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:24.850347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:25.081340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:25.096739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-31ac57ef-6669-4f42-b1c3-4594c527db64 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1554 microversion: 2.1 time: 0.713698 Jun 04 09:27:25.102044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 85/159] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:24 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1554 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:25.350224 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7e4010da-8bd4-481e-91f9-fc659b84c510 req-7f274e7b-1906-4db6-84ae-39a733ccfec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5b1685-7f08-4537-99c6-95643dd6a29e", "name": "network-vif-deleted", "tag": "7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:25.405190 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7e4010da-8bd4-481e-91f9-fc659b84c510 req-7f274e7b-1906-4db6-84ae-39a733ccfec0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:25.408110 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7e4010da-8bd4-481e-91f9-fc659b84c510 req-7f274e7b-1906-4db6-84ae-39a733ccfec0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:25.447371 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7e4010da-8bd4-481e-91f9-fc659b84c510 req-7f274e7b-1906-4db6-84ae-39a733ccfec0 service nova] Creating event network-vif-deleted:7ad2b3b7-c858-4b6d-abb3-5ecbf45eefaa for instance 6a5b1685-7f08-4537-99c6-95643dd6a29e on hv-cinder-84469 Jun 04 09:27:25.454183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7e4010da-8bd4-481e-91f9-fc659b84c510 req-7f274e7b-1906-4db6-84ae-39a733ccfec0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137892 Jun 04 09:27:25.455792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 86/160] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:27:25.462086 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:25.463929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:25.472362 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:25.473186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:25.474305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:25.474958 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:25.551652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:25.567719 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b4f8bb74-89e8-44d3-a807-cd810a3aa67c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.738624 Jun 04 09:27:25.574671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 75/161] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:24 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:25.907182 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:25.916423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09a5cc30-1629-4241-9403-e84df77e0033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1556 microversion: 2.1 time: 0.458903 Jun 04 09:27:25.916956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 87/162] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:25 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1556 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:25.944280 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:25.944806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:25.952229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:25.952892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:25.954392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:25.955332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:26.053131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-83d06767-4eae-4632-91eb-746cdd5a98be tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113521 Jun 04 09:27:26.054087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 76/163] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:27:25 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:27:26.119922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:26.121938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:26.144369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:26.146721 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:26.147987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:26.148476 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:26.260732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:26.277121 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23879e70-e914-4e15-bdcc-c083cd412662 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1346 microversion: 2.1 time: 0.164168 Jun 04 09:27:26.284799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 88/164] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:26 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:26.591427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:26.592866 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:26.599985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:26.600761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:26.601708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:26.603352 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:26.805563 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:26.814632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-19790c6e-21b6-4295-a143-6eef8ba3a8be tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.227098 Jun 04 09:27:26.815238 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 77/165] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:26 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:27.298671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:27.299802 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:27.323753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.325249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.327250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.328646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.392929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.394611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.395958 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lazy-loading 'fault' on Instance uuid 6a5b1685-7f08-4537-99c6-95643dd6a29e {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:27:27.464080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a0478618b1430b9c8c609618257eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29bb9979415948f685ad1fe8d58bfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:27.479895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db25edbc-006d-4f85-b923-30e7dec0761f tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 200 len: 1351 microversion: 2.1 time: 0.190018 Jun 04 09:27:27.481015 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 89/166] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:27 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:27.849511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:27.852622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:27.854357 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-16306037-451d-46d6-8252-06dbb9a7e692 req-564ca383-05b3-40d7-b6a4-d303d1eb4f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c900d7-98de-4ba9-a6d7-98bc2194c582", "tag": "edfbce93-3cd9-4178-ab5b-64cba09aa8ad"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:27:27.880372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-16306037-451d-46d6-8252-06dbb9a7e692 req-564ca383-05b3-40d7-b6a4-d303d1eb4f73 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.881171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-16306037-451d-46d6-8252-06dbb9a7e692 req-564ca383-05b3-40d7-b6a4-d303d1eb4f73 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.888601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.889332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.890856 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:27.891587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:27.896601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:27.936136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-16306037-451d-46d6-8252-06dbb9a7e692 req-564ca383-05b3-40d7-b6a4-d303d1eb4f73 service nova] Creating event network-changed:edfbce93-3cd9-4178-ab5b-64cba09aa8ad for instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 on hv-cinder-84469 Jun 04 09:27:27.950408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-16306037-451d-46d6-8252-06dbb9a7e692 req-564ca383-05b3-40d7-b6a4-d303d1eb4f73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103135 Jun 04 09:27:27.953005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 90/167] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:27:28.463072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:28.507268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6a82a385-ea49-4066-b943-6e9ba5f15c51 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.675511 Jun 04 09:27:28.510956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:28.511758 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:28.514617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 78/168] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:27 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:28.534426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:28.534426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:28.534426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:28.534426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:28.561535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] HTTP exception thrown: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Request method failure captured: Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e HTTP/1.1 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyU1dBLJidxXBdjli3ILy4XiscKua5-kze-Jielpgc9GiLk5_RKpvftPtB7gWIqo_zDp804Vp9rMOqDGO_1qZ2xqwNZhyAGS_QPEtvwfJHXIkUB3m113gQsVvswZKI5QeWDBDKt2f_A47InGCwSAW4IlUOA2bGBKwXbtgf61y0Ttm7U Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:27:28.611017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_29bb9979415948f685ad1fe8d58bfb20", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: c1a0478618b1430b9c8c609618257eca Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.612541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '6a5b1685-7f08-4537-99c6-95643dd6a29e'} Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:27:28.613350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.614739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.616013 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Returning 404 to user: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:27:28.621983 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-895c10c7-69e5-4765-9fc0-fbcd725c5763 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 404 len: 111 microversion: 2.1 time: 0.109096 Jun 04 09:27:28.622486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 91/169] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:28 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:27:28.860737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:28.862506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:28.897819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:28.898609 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:28.900088 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:28.900913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:28.954083 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] HTTP exception thrown: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Request method failure captured: Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e/os-volume_attachments HTTP/1.1 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyU1dBLJidxXBdjli3ILy4XiscKua5-kze-Jielpgc9GiLk5_RKpvftPtB7gWIqo_zDp804Vp9rMOqDGO_1qZ2xqwNZhyAGS_QPEtvwfJHXIkUB3m113gQsVvswZKI5QeWDBDKt2f_A47InGCwSAW4IlUOA2bGBKwXbtgf61y0Ttm7U Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:27:28.974845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_29bb9979415948f685ad1fe8d58bfb20", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: c1a0478618b1430b9c8c609618257eca Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.977756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'server_id': '6a5b1685-7f08-4537-99c6-95643dd6a29e'} Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:27:28.980095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:28.982775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:28.985922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Returning 404 to user: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:27:28.985922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1da5f83f-942f-4ed8-a7ce-ed15d1bede08 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.128227 Jun 04 09:27:28.985922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 79/170] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:27:28 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e/os-volume_attachments => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:27:29.539732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:29.540653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:29.551542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:29.552401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:29.556240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:29.556898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:29.811223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:29.817944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c05bb293-44c7-4bbf-9fbd-349da9e1ff90 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.282300 Jun 04 09:27:29.818542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 92/171] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:29 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:30.575422 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:30.576227 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:30.581863 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=84 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:30.590454 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.591226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:30.592775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.594851 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:30.622607 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] HTTP exception thrown: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Request method failure captured: Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e HTTP/1.1 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyU1dBLJidxXBdjli3ILy4XiscKua5-kze-Jielpgc9GiLk5_RKpvftPtB7gWIqo_zDp804Vp9rMOqDGO_1qZ2xqwNZhyAGS_QPEtvwfJHXIkUB3m113gQsVvswZKI5QeWDBDKt2f_A47InGCwSAW4IlUOA2bGBKwXbtgf61y0Ttm7U Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:27:30.627297 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_29bb9979415948f685ad1fe8d58bfb20", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: c1a0478618b1430b9c8c609618257eca Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.629967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '6a5b1685-7f08-4537-99c6-95643dd6a29e'} Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:27:30.631362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.633726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.635974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Returning 404 to user: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:27:30.635974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6a0bec02-f3eb-4750-bf8c-0779e044cd59 tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 404 len: 111 microversion: 2.1 time: 0.061869 Jun 04 09:27:30.635974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 80/172] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:27:30 2022] DELETE /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:27:30.641741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:30.642496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] [instance: 6a5b1685-7f08-4537-99c6-95643dd6a29e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:30.650394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.650841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:30.651636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.652071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:30.667877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] HTTP exception thrown: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Request method failure captured: Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e HTTP/1.1 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyU1dBLJidxXBdjli3ILy4XiscKua5-kze-Jielpgc9GiLk5_RKpvftPtB7gWIqo_zDp804Vp9rMOqDGO_1qZ2xqwNZhyAGS_QPEtvwfJHXIkUB3m113gQsVvswZKI5QeWDBDKt2f_A47InGCwSAW4IlUOA2bGBKwXbtgf61y0Ttm7U Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:27:30.669471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_29bb9979415948f685ad1fe8d58bfb20", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/29bb9979415948f685ad1fe8d58bfb20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 29bb9979415948f685ad1fe8d58bfb20 Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-DeleteServersTestJSON-1989211451 Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: c1a0478618b1430b9c8c609618257eca Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-DeleteServersTestJSON-1989211451-project Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.671608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '6a5b1685-7f08-4537-99c6-95643dd6a29e'} Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:27:30.672617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. Jun 04 09:27:30.674452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:27:30.676188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] Returning 404 to user: Instance 6a5b1685-7f08-4537-99c6-95643dd6a29e could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:27:30.676188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e6e82feb-03a6-4cba-8023-fc5a3942b5fc tempest-DeleteServersTestJSON-1989211451 tempest-DeleteServersTestJSON-1989211451-project] 10.222.0.46 "GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e" status: 404 len: 111 microversion: 2.1 time: 0.033441 Jun 04 09:27:30.676188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 93/173] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:30 2022] GET /compute/v2.1/servers/6a5b1685-7f08-4537-99c6-95643dd6a29e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:27:30.845117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:30.847373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:30.869208 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.871919 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:30.873559 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:30.874020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:31.347262 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:31.357922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e9ebc297-f6e6-4fef-8005-c1e8f8c58389 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.521545 Jun 04 09:27:31.359239 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 81/174] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:30 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:32.396497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:32.398580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:32.408432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:32.409137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:32.410345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:32.411083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:32.614155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:32.629748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1bbe4430-0776-45eb-977a-251463e790ca tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.240613 Jun 04 09:27:32.630791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 94/175] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:32 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:33.650442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:33.652254 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:33.663255 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:33.663847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:33.665406 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:33.665941 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:33.864915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:33.879807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9f90bdd6-0b63-4fb4-9c54-2f52119d5d17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.234274 Jun 04 09:27:33.880920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 82/176] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:33 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:34.900452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:34.902887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:34.915520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:34.916731 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:34.918095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:34.918820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:35.167666 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:35.186833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bb81935f-7cdd-468c-b9d8-e2875d654db4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.292844 Jun 04 09:27:35.188000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 95/177] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:34 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:36.216886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:36.218245 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:36.226469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:36.227188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:36.229680 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:36.230173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:36.448019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:36.456369 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-59d6a9e8-f748-4358-ba0e-2e1844a3bc99 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.243753 Jun 04 09:27:36.456984 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 83/178] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:36 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:37.478903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:37.480010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:37.489591 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:37.490105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:37.491037 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:37.491519 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:37.666167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:37.677332 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5caf302e-5624-4873-b9a0-715a4aac08c8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.206330 Jun 04 09:27:37.678228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 96/179] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:37 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:38.700782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:38.702450 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:38.713604 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:38.714313 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:38.715545 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:38.716443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:38.892972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:38.912799 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8f70a7f4-64a0-4f2f-b89d-b5682b2cfee1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.220408 Jun 04 09:27:38.914470 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 84/180] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:38 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:39.944828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:39.949778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:39.963238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:39.964918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:39.965466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:39.966088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:40.258352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:40.274640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bd712340-884c-4284-8f72-d59984334844 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.337407 Jun 04 09:27:40.290129 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 97/181] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:39 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:41.301245 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:41.302160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:41.310022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:41.310475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:41.311279 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:41.311770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:41.544162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:41.558597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f89fd0e-a5e8-4119-b817-ac611dafbcc5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.261014 Jun 04 09:27:41.559728 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 85/182] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:41 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:42.583925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:42.587710 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:42.606326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:42.608758 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:42.615137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:42.615137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:42.938711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:42.952119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c7692a9e-d8ad-4bde-845f-391feb057168 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.376326 Jun 04 09:27:42.952968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 98/183] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:42 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:43.976241 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:43.976922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:43.983526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:43.983976 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:43.984792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:43.985234 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:44.222036 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:44.236939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b9512381-89ec-4caf-af56-4a978e981bd2 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.266654 Jun 04 09:27:44.249216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 86/184] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:43 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:45.264437 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:45.265485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:45.278400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:45.279485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:45.281289 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:45.282091 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:45.503351 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:45.520433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-17bc937e-a046-4bdd-b4e5-f02e3831f7e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.260200 Jun 04 09:27:45.521698 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 99/185] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:45 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:46.545258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:46.546359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:46.558891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:46.559307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:46.561087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:46.562314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:46.781951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:46.798025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-83e1b8cb-559a-4c8d-af58-12f9a3c61de9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.261079 Jun 04 09:27:46.809622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 87/186] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:46 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:47.827725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:47.828895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:47.832981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:47.842403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:47.843196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:47.844557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:47.845355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:48.112858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:48.112858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-efaf88ec-6dd6-45d3-a975-d4b6ed6237bc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.268469 Jun 04 09:27:48.112858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 100/187] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:47 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:49.118426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:49.118426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:49.124525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:49.125587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:49.127196 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:49.128118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:49.504891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:49.519246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8caf382a-29df-485e-a330-0b9d2f9875a9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.412418 Jun 04 09:27:49.520609 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 88/188] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:49 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:50.541577 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:50.542507 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:50.549946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:50.550392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:50.551219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:50.551654 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:50.742823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:50.756717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5dc31034-78c8-46be-8040-1d6c5e7a6fbd tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.218423 Jun 04 09:27:50.769424 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 101/189] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:50 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:27:51.784659 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:51.785537 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:51.795313 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:51.796075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:51.797536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:51.798306 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:52.028620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:52.036653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c1fcb4be-e713-4e2a-a832-1568333ed968 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.255995 Jun 04 09:27:52.037488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 89/190] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:51 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:53.062706 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:53.064074 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:53.072620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:53.073070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:53.073870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:53.074322 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:53.089084 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:27:53.250404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:53.258902 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ee6b1d55-ef31-4733-9d85-3208a000b743 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.206916 Jun 04 09:27:53.259488 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 102/191] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:53 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:54.290630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:54.292675 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:54.313995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:54.314699 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:54.315759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:54.316344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:54.508798 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:54.524654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-30406810-ce5a-428a-bf05-453906669ce8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.241178 Jun 04 09:27:54.525697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 90/192] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:54 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:55.558980 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:55.559915 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:55.569261 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:55.569838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:55.570711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:55.571166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:55.798294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:55.808352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6e5882fd-aa4c-4b50-9f85-e18a01478ba5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.260895 Jun 04 09:27:55.809572 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 103/193] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:55 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:56.828187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:56.829029 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:56.836181 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:56.836757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:56.839566 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:56.839566 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:57.008176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:57.016605 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5dc02d46-baed-4452-8f0e-feac27bbc99b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.192122 Jun 04 09:27:57.017220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 91/194] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:56 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:58.034922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:58.035700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:58.049370 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:58.050224 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:58.051354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:58.052665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:58.334648 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:58.348015 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2481f72-c960-45f9-a4a2-8104acc7d054 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1522 microversion: 2.1 time: 0.318389 Jun 04 09:27:58.357988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 104/195] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:58 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:59.365912 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:59.366533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:59.373706 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:59.374316 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:59.375111 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:59.375561 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:59.578519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:59.586682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-89afc869-cc9f-475d-92c7-af57328785b6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1502 microversion: 2.1 time: 0.224876 Jun 04 09:27:59.587289 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 92/196] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:59 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:27:59.616854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:27:59.617938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:27:59.632801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:59.632801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:59.632801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:27:59.633174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:27:59.848010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:27:59.869255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fca5077c-4769-4fa9-b4c5-815679c9df2f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1516 microversion: 2.1 time: 0.259268 Jun 04 09:27:59.890852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 105/197] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:27:59 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:03.061231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:03.063285 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:03.076961 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:03.078079 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:03.079812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:03.080774 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:03.133038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'flavor' on Instance uuid d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:28:03.659467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e5dcea34-8e81-4a66-a584-cffa1e518a86 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/action" status: 200 len: 32 microversion: 2.1 time: 0.607673 Jun 04 09:28:03.661635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 93/198] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:28:03 2022] POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/action => generated 32 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:28:03.676153 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:03.677394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:03.690445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:03.695223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:03.695223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:03.695223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:03.949969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:03.969963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-939cc9d8-4db3-4f56-a820-1f32c822e4c7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.301044 Jun 04 09:28:03.971297 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 106/199] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:03 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:04.995427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:04.996531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:04.999371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=28 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:05.008132 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:05.008875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:05.009860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:05.010440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:05.016004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:05.217606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:05.225989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-125d069e-3451-4490-8f08-a4d6c6959ca6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.237552 Jun 04 09:28:05.226853 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 94/200] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:04 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:06.243439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:06.244106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:06.251138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:06.251602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:06.255214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:06.255881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:06.532981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:06.544570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-93870622-40ec-4805-928b-129fdd8c39d6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.305095 Jun 04 09:28:06.545410 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 107/201] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:06 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:07.574957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:07.576138 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:07.589570 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:07.590389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:07.591836 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:07.592661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:07.782788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:07.820137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d0c3fff-73d5-4657-aaf2-d71dc6006d2c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.247104 Jun 04 09:28:07.822037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 95/202] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:07 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:08.840990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:08.841800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:08.848672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:08.849124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:08.849910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:08.850344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:09.253734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:09.266277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e96f0d6c-5332-4036-b14e-45ce72e410fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.428823 Jun 04 09:28:09.267670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 108/203] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:08 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:10.287861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:10.288707 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:10.297192 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:10.297852 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:10.298635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:10.299284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:10.494123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:10.510021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7a9eb70b-278b-43ad-be40-fdda45db2792 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.225819 Jun 04 09:28:10.511606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 96/204] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:10 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:11.391583 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:11.392486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:11.401022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.401569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.402509 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.403039 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.432897 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-add35e04-93a2-4fae-b63e-4215e058f9ca tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/ips" status: 200 len: 146 microversion: 2.1 time: 0.045881 Jun 04 09:28:11.433412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 109/205] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:28:11 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:28:11.529168 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:11.529977 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:11.537016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.537466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.538282 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.538731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.728935 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:11.743000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-16b49af2-0268-4fd5-bc16-27527509bfff tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.217485 Jun 04 09:28:11.743773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 97/206] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:11 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:11.825054 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:11.826000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:11.836520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.837105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.838327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:11.838898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:11.870942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e2e747a-ee1e-4b0f-8bcd-ce321e7513c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/ips" status: 200 len: 150 microversion: 2.20 time: 0.051479 Jun 04 09:28:11.878807 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 110/207] 10.222.0.46 () {60 vars in 1288 bytes} [Sat Jun 4 09:28:11 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:28:12.769284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:12.770461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:12.782300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:12.782975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:12.785237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:12.786086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:12.947243 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:12.963500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a11a7bb2-6d46-4b44-a509-040a7aed1df7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.203222 Jun 04 09:28:12.964691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 98/208] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:12 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:13.981671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:13.983055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:13.996219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:13.996994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:13.998397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:13.999142 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:14.279949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:14.296400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-550ed6c7-692e-4509-9b18-523a6a1c6c15 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.318810 Jun 04 09:28:14.298220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 111/209] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:13 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:14.708491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:14.710009 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:14.720394 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:14.721198 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:14.722669 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:14.723502 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:14.763654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lazy-loading 'flavor' on Instance uuid 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:28:15.327509 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:15.329640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:15.347265 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.347265 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.347265 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.347265 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.672323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:15.686260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ccc15a20-09df-47be-a0da-685e7c7eec1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.367156 Jun 04 09:28:15.699164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 112/210] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:15 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:15.708317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:15.709181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:15.719470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.719932 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.721023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.721499 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.766470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1c34b708-9aad-418e-81bd-9cc492751ae8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/ips" status: 200 len: 149 microversion: 2.1 time: 0.066429 Jun 04 09:28:15.774669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 113/211] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:28:15 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:15.782266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43e4310f-0a69-46e4-a17d-c33a7e93de32"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:15.784468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:15.796227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.797061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.799430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.799988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.834183 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b0fbef2d-117b-4d71-aa10-d33eccf4039a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/action" status: 202 len: 0 microversion: 2.20 time: 1.132472 Jun 04 09:28:15.835572 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 99/212] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jun 4 09:28:14 2022] POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/action => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:28:15.844540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:15.845458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:15.852922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.853469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:15.854537 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:15.854976 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:16.061052 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:16.078603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:16.078603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:16.078603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-85daec05-589e-4735-83cf-cfa923abc5f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.235715 Jun 04 09:28:16.079123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 100/213] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:15 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:16.710396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:16.711913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:16.723423 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:16.724236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:16.725250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:16.725810 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:16.901919 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:16.910745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-612392bd-04ee-4ad3-96df-a4214bc98f87 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.207779 Jun 04 09:28:16.911624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 101/214] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:16 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:17.097358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:17.098039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:17.104607 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:17.105057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:17.105873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:17.106395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:17.268635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:17.284780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:17.286385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:17.287627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8e0843de-c1f5-4129-89f8-b09c9f3c17dd tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.195438 Jun 04 09:28:17.288241 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 102/215] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:17 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:17.934511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:17.942541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:17.944710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:17.945281 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:17.946129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:17.946696 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:18.151268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:18.161484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0027ffe5-675a-41e6-9ef2-80f48694a23b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.231421 Jun 04 09:28:18.162080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 103/216] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:17 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:18.246542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09998de9-bd35-44cb-b7a1-51aca5a13065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.475661 Jun 04 09:28:18.248461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 114/217] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:28:15 2022] POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments => generated 194 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:18.307547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:18.308982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:18.316778 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:18.317288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:18.318072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:18.318556 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:18.495185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:18.515423 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:18.519048 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:18.521322 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-661c3d94-79d1-4658-b62d-fa176284f5cf tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.217515 Jun 04 09:28:18.522338 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 104/218] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:18 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:18.526747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c93e30e-bcd2-44d1-b91b-1251bf8a13d3"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:18.528120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:18.535329 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:18.535854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:18.536749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:18.537245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:19.189044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:19.189970 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:19.199368 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:19.200163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:19.201661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:19.202448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:19.377190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:19.385636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77d1dd26-dc39-4c9f-90f1-28f72680a1e8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.202453 Jun 04 09:28:19.386238 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 105/219] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:19 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:19.550155 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:19.551469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:19.561127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:19.561127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:19.562069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:19.562642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:19.780990 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:19.798224 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:19.800569 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:19.802580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b62bfede-42ff-4814-bdda-0f6e408e07d0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.257076 Jun 04 09:28:19.803670 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 106/220] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:19 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:20.413580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:20.420357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:20.420724 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:20.421188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:20.421972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:20.422403 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:20.483407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-115afb5d-9000-4bcb-badb-9a6aa5efb098 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.959072 Jun 04 09:28:20.483407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 115/221] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:28:18 2022] POST /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments => generated 194 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:28:20.710505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:20.731301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0b03721b-d8aa-4c3a-a3b4-5b021ac9dd13 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.321004 Jun 04 09:28:20.746697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 107/222] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:20 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:20.838704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:20.839761 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:20.848634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:20.849283 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:20.850441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:20.851083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:21.060599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:21.069952 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:21.071507 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:21.072774 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-34313f0b-0030-47e8-b69b-e564635dd2a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.241340 Jun 04 09:28:21.073404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 116/223] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:20 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:21.766293 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:21.767140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:21.778777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:21.779329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:21.780203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:21.780683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:22.095649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:22.097132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:22.118729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:22.119537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:22.120744 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:22.121423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:22.149778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:22.358366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:22.358366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:22.358366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-092b94c5-b8f2-4e6e-86d7-113f4c4b5b3b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.593662 Jun 04 09:28:22.358366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 108/224] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:21 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:22.407475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:22.427104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:22.433493 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:22.437349 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7961d559-14ad-41cd-a95a-fb8914e251c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.345774 Jun 04 09:28:22.438181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 117/225] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:22 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:23.382286 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:23.382865 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:23.390216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:23.390681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:23.391590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:23.392113 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:23.458519 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:23.459207 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:23.463429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=36 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:23.469407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:23.470440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:23.471318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:23.471851 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:23.660362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:23.672772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dc77b7b2-a0f6-4509-82b0-45c8b6172cfc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.294492 Jun 04 09:28:23.674555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 109/226] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:23 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:23.708513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:23.718199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:23.719865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:23.724954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e6a06e9-b88e-4ac5-9e46-be6c010f4d9e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.268157 Jun 04 09:28:23.724954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 118/227] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:23 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:24.701530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:24.702925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:24.715953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:24.719415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:24.719415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:24.719415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:24.747853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:24.749166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:24.759673 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:24.762631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:24.762631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:24.762631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.004396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:25.005531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:25.013493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-001003af-e0c4-49b4-85a1-4e8793a82b56 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1502 microversion: 2.1 time: 0.316849 Jun 04 09:28:25.014490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 110/228] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:24 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:25.019691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:25.030546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:25.032459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10f6f94c-a07e-414b-b0eb-644c4dc107f5"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:25.033062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-773798d4-9f9c-4f04-ae8d-8a65f71f85e6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.294268 Jun 04 09:28:25.033862 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:25.034169 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 119/229] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:24 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:25.043361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.043361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.043361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.043361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.070943 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] HTTP exception thrown: Cannot 'attach_volume' instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 while it is in vm_state rescued Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Request method failure captured: Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/os-volume_attachments HTTP/1.1 Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 74 Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVHcosoWg4BkQ3m39Jw8redzlOM5ZqGfaRM5DyEYeFsJFrwbLK94TPaWAP4jk1gXl_fXNWbXw7HbRrztESHYfXZfSdysapX2P3MsRkFWlYGzC_0Scq47em5ewBvkKym0v4zc_7k710Vza6mw7MzipJj2JZWhvYc0Q2c7HKkVFD6NSI Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:28:25.073139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e42983d2d3964b8cb5d32e6d653d6dfd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 34a7ef6d33b141ce8fb1cec517faffd1 Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {"volumeAttachment": {"volumeId": "10f6f94c-a07e-414b-b0eb-644c4dc107f5"}} Jun 04 09:28:25.075754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Cannot 'attach_volume' instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 while it is in vm_state rescued Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'server_id': 'd1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4', 'body': {'volumeAttachment': {'volumeId': '10f6f94c-a07e-414b-b0eb-644c4dc107f5'}}} Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:28:25.076849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 while it is in vm_state rescued Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:28:25.078436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 while it is in vm_state rescued Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Returning 409 to user: Cannot 'attach_volume' instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 while it is in vm_state rescued {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0d8b18d0-0bd7-487d-8d28-805172329e6e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046838 Jun 04 09:28:25.079895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 111/230] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:28:25 2022] POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 04 09:28:25.086041 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:25.086700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:25.094498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.095331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.096595 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.097102 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.437351 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d458516b-f1f1-499f-977e-7ffcb91330aa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/action" status: 202 len: 0 microversion: 2.1 time: 0.356069 Jun 04 09:28:25.438175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 120/231] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:28:25 2022] POST /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:28:25.448654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:25.449850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:25.460934 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.461721 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.463089 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:25.463876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:25.691608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:25.701802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9581c666-1cb8-4796-9ba4-c463c1301bbf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.259053 Jun 04 09:28:25.702454 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 112/232] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:25 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:26.063227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:26.063985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:26.071909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:26.072403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:26.073220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:26.073662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:26.262033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:26.271177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:26.274131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:26.278043 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-949ba614-808b-4f68-9b7f-c37e9a69ca38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.220186 Jun 04 09:28:26.278337 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 121/233] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:26 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:26.719233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:26.719937 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:26.727426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:26.728376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:26.729361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:26.729796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:26.929483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:26.940217 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9ee36728-ce25-4418-ad97-35a7182b3fb9 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.224596 Jun 04 09:28:26.941158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 113/234] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:26 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:27.298647 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:27.301766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:27.307333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:27.307775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:27.308586 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:27.309015 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:27.458214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:27.467578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:27.469116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:27.470954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3401560f-5617-4e10-9493-644b5f78f0f3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.178690 Jun 04 09:28:27.471503 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 122/235] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:27 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:27.627529 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-22bd2ca9-b4bd-4ae7-a342-41ab00db0259 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:27.635173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-22bd2ca9-b4bd-4ae7-a342-41ab00db0259 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:27.639615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-22bd2ca9-b4bd-4ae7-a342-41ab00db0259 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:27.701035 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-22bd2ca9-b4bd-4ae7-a342-41ab00db0259 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Going to try to stop instance {{(pid=118476) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 09:28:27.961323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:27.962200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:27.971671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:27.972532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:27.973928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:27.974441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:28.014087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-22bd2ca9-b4bd-4ae7-a342-41ab00db0259 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action" status: 202 len: 0 microversion: 2.1 time: 0.391959 Jun 04 09:28:28.015021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 114/236] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:28:27 2022] POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:28:28.025345 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:28.028528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:28.037678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:28.038137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:28.038960 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:28.040279 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:28.164310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:28.179760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b69adf5f-c403-473e-8244-6bf495c37c8b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.223382 Jun 04 09:28:28.180958 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 123/237] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:27 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:28.254409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:28.269083 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4d561e75-b3bc-4db9-b3ca-b7d4c779530c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.247934 Jun 04 09:28:28.269908 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 115/238] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:28 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:28.491067 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:28.491626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:28.498638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:28.501733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:28.501733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:28.501733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:28.662010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:28.670901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:28.672512 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:28.673723 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b02ac8e6-02a8-4e4f-9102-a30adb30d4b8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.186975 Jun 04 09:28:28.674304 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 124/239] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:28 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:29.200824 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:29.201443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:29.208231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.208711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.209501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.209940 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.300735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:29.301633 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:29.308648 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.309149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.309918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.310384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.450510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:29.458627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9476a3d0-bd1e-4d55-b66d-cc0ea9137178 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.261673 Jun 04 09:28:29.459452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 116/240] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:29 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:29.489264 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:29.498400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-02382440-cd66-4710-a05f-43c10bab219d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.202148 Jun 04 09:28:29.499114 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 125/241] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:29 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:29.692761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:29.693348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:29.699653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.700101 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.700921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:29.701358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:29.856393 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:29.865318 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:29.867273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:29.868611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c107a895-9e59-4380-8cf0-f1b711a2693f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.179899 Jun 04 09:28:29.869325 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 117/242] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:29 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:30.479797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:30.480559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:30.487742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.488191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:30.489023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.489459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:30.516424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:30.517248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:30.523931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.524753 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:30.525580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.526021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:30.767268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:30.776127 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49e8c8dd-9c2e-4487-a0b0-433afdc18609 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.300477 Jun 04 09:28:30.776759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 126/243] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:30 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:30.793193 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:30.803714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-47d8e636-3ee7-46b4-936b-caf784f54f72 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.291203 Jun 04 09:28:30.804353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 118/244] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:30 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:30.887555 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:30.888075 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:30.895271 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.895773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:30.897228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:30.898012 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:31.054715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:31.063944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:31.065914 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:31.067141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-488f26e9-3b20-45a3-bb0d-ea20fb125419 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.183835 Jun 04 09:28:31.067737 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 127/245] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:30 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:31.795143 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:31.795787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:31.802827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:31.803262 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:31.804038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:31.804496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:31.824831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:31.826195 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:31.833885 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:31.834485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:31.835380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:31.836536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:32.042555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:32.051520 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cd937f05-e0aa-4f8f-aa3a-20f1b191a344 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1510 microversion: 2.1 time: 0.260003 Jun 04 09:28:32.051849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 119/246] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:31 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:32.054139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:32.063507 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5cfda5ed-fb18-470d-b827-9d82f6620462 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.242939 Jun 04 09:28:32.064219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 128/247] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:31 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:32.088265 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:32.089304 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:32.097465 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:32.098123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:32.099043 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:32.099715 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:32.320245 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:32.328805 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:32.330348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:32.331540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b8e3302a-de47-4552-b0e9-25258a84a854 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.248440 Jun 04 09:28:32.332122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 120/248] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:32 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:33.077817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:33.079254 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:33.082750 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:33.083491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:33.086840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.087593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.088729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.089165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.089957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.090412 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.091207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.091647 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.305137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:33.318287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8553b3ad-cd56-45ea-bead-4e053317e96b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.240445 Jun 04 09:28:33.319711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 121/249] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:33 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:33.328180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:33.339388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b710859e-c2bd-4dd2-9b79-046fbeb51c93 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1516 microversion: 2.1 time: 0.265781 Jun 04 09:28:33.340108 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 129/250] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:33 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:33.364118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:33.364118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:33.368480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.369045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.369945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:33.370477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:33.570797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:33.586623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:33.589725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:33.591773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-62066bfc-129a-4388-b833-493e2b5cbfb5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.238787 Jun 04 09:28:33.592847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 122/251] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:33 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:34.346740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:34.347922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:34.360451 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:34.361048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:34.362292 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:34.363092 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:34.510778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:34.519395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-96b65c60-c146-4257-9fc3-a3fad610dd26 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.180099 Jun 04 09:28:34.527489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 130/252] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:34 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:34.613627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:34.615060 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:34.623361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:34.624010 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:34.624866 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:34.625448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:34.766319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:34.776086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:34.777690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:34.778882 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-40d5deb0-4647-495f-9a32-b4721dcc9f59 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.170622 Jun 04 09:28:34.779448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 123/253] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:34 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:35.537345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:35.538083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:35.547889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:35.549049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:35.550379 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:35.551125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:35.713206 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:35.721785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c0a7c840-5fbf-4d08-b0cd-0fda0ef5c2b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.188382 Jun 04 09:28:35.722447 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 131/254] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:35 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:35.798802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:35.799615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:35.809952 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:35.810547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:35.811823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:35.813148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:36.013518 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:36.018137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:36.027542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:36.030801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:36.033608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c92fedd5-4815-4eca-9e68-62744170622e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.239005 Jun 04 09:28:36.034679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 124/255] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:35 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:36.744075 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:36.745272 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:36.754546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:36.755044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:36.755796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:36.756231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:36.919843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:36.922665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:36.929901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1b9ff90b-7581-4816-8f87-67106c64880d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.193980 Jun 04 09:28:36.931607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 132/256] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:36 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:37.063822 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:37.064564 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:37.071448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:37.071900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:37.072744 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:37.073214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:37.263532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:37.275002 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:37.278075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:37.280171 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bd4c25b6-8e8e-48e3-b18a-444a453563c2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.223899 Jun 04 09:28:37.281187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 125/257] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:37 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:37.320726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4179e075-7f72-4b88-971a-f0b51791c427 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: .version_select at 0x7fa416135c10>, body: {"keypair": {"name": "tempest-keypair-1169491684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElOW9G7GpmlspMyAKJ801J+cFSfsMNPiero/YnwXMNAbloZbDfPOPNpp90TKWW7XTyOCLRbW7RHH5R95bVVmHrme2WfEepuzUFdNbI8m7eBJwsT3foRBnx9Z+UBm43a2A=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:37.337063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-4179e075-7f72-4b88-971a-f0b51791c427 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:28:37.341525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-4179e075-7f72-4b88-971a-f0b51791c427 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for user 34a7ef6d33b141ce8fb1cec517faffd1 and project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:28:37.472471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4179e075-7f72-4b88-971a-f0b51791c427 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155839 Jun 04 09:28:37.473254 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 133/258] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:28:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:37.898348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f80d5a5d-4c11-4ddc-8afa-2d83e7c4ace0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: .version_select at 0x7fa4160a9310>, body: {"keypair": {"name": "tempest-keypair-1982247592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC/j1HdYyiWmWdOIBWgOV/iyvgqAi9m8ZbBANRRJ/4C2nvNH9YFa42WwrhVWkqFvgrhsl8SdFQtkU/sDlPttsWnrqMPX9nmj70ups3j9S4i4pB4SeFJS3jjefDs816HqQ=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:37.902520 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=64 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:37.915634 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-f80d5a5d-4c11-4ddc-8afa-2d83e7c4ace0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:28:37.920329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-f80d5a5d-4c11-4ddc-8afa-2d83e7c4ace0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:28:37.950059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:37.950881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:37.958202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:37.958655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:37.959463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:37.959899 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:38.052531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f80d5a5d-4c11-4ddc-8afa-2d83e7c4ace0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158665 Jun 04 09:28:38.053266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 126/259] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:28:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:38.147538 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:38.161184 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ebc2bcd5-2dd6-44b9-b3ef-9f5710ef1607 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.215431 Jun 04 09:28:38.162522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 134/260] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:37 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:38.313608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:38.315464 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:38.326061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:38.326699 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:38.327648 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:38.328786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:38.410513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-beb68e85-92c1-4403-92b5-c2c03f079448 req-560ca22c-dd20-4d07-8a68-a8eb42821052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:38.425415 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-beb68e85-92c1-4403-92b5-c2c03f079448 req-560ca22c-dd20-4d07-8a68-a8eb42821052 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:38.426713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-beb68e85-92c1-4403-92b5-c2c03f079448 req-560ca22c-dd20-4d07-8a68-a8eb42821052 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:38.450578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-beb68e85-92c1-4403-92b5-c2c03f079448 req-560ca22c-dd20-4d07-8a68-a8eb42821052 service nova] Creating event network-vif-plugged:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:28:38.459705 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-beb68e85-92c1-4403-92b5-c2c03f079448 req-560ca22c-dd20-4d07-8a68-a8eb42821052 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064158 Jun 04 09:28:38.461711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 135/261] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:38.526374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:38.536179 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:38.537826 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:38.551976 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77f353de-3f31-470f-a37c-7d9e2df80d1c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.234480 Jun 04 09:28:38.551976 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 127/262] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:38 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:39.187285 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:39.188190 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:39.196185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:39.196851 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:39.197762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:39.198197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:39.518112 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:39.534092 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-19dbf4e3-1e6e-4516-8c79-7f3e14f2436b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.351454 Jun 04 09:28:39.535286 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 136/263] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:39 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:39.566507 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:39.567266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:39.575037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:39.575504 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:39.576401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:39.576837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:39.835064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:39.850354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:39.853623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:39.856156 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-88b8c466-22b6-4ba7-ad8c-5a106326e2a7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1741 microversion: 2.20 time: 0.293277 Jun 04 09:28:39.857269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 128/264] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:39 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:40.565531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:40.566834 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:40.577606 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:40.578080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:40.578909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:40.582141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:40.784650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:40.795242 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a2841b3c-2a3e-44fe-877e-30461ddd8d8e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.233567 Jun 04 09:28:40.807210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 137/265] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:40 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:40.884807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:40.885442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:40.893249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:40.893892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:40.894838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:40.896119 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:41.075478 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:41.085411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:41.087048 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:41.088651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1e5b7c3d-b0a0-400f-a59a-ef239ae54dc1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.207836 Jun 04 09:28:41.092351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 129/266] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:40 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:41.406369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-744123334", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "440b27b7-eea1-406f-839f-e25bf291973d"}], "security_groups": [{"name": "tempest-securitygroup--984039393"}], "key_name": "tempest-keypair-1169491684", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:41.701683 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] validate_networks() for [('440b27b7-eea1-406f-839f-e25bf291973d', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:28:41.705476 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1533802568", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72d5f400-ff54-4f35-902d-3289af4496b7"}], "security_groups": [{"name": "tempest-securitygroup--1632033726"}], "key_name": "tempest-keypair-1982247592", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:41.985681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] validate_networks() for [('72d5f400-ff54-4f35-902d-3289af4496b7', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:28:42.899090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:28:42.899614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:28:42.899992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:28:42.900427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:28:42.901028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:28:42.923808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:42.924841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:42.926698 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:42.927573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:42.966298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:28:42.974546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Getting quotas for user 34a7ef6d33b141ce8fb1cec517faffd1 and project e42983d2d3964b8cb5d32e6d653d6dfd. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:28:43.006781 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:28:43.013653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:28:43.043063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:28:43.043773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:28:43.043947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:28:43.044591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:28:43.045331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:28:43.061214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.063996 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.065157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.065772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.106391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:28:43.116233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:28:43.143296 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:28:43.148591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:28:43.276237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c4855a7d-109c-40cf-9744-b0232b76e910 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.876781 Jun 04 09:28:43.282108 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 138/267] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:28:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 09:28:43.295704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:43.297502 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:43.316921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.318159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.320402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.321751 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.425833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eb093f86-bb59-46b9-be56-a570405a24dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.724989 Jun 04 09:28:43.428079 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 130/268] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:28:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:28:43.439376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:43.440773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:43.457144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.460642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.462488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:43.466313 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:43.771164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:43.817152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-431e9516-e4ad-494a-86c9-6805331ef88d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.530554 Jun 04 09:28:43.822861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 139/269] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:43 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:43.843480 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-169712e0-5e29-4df4-980e-e25f7edde1d0 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:43.844681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-169712e0-5e29-4df4-980e-e25f7edde1d0 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:44.000555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:44.010942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-169712e0-5e29-4df4-980e-e25f7edde1d0 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:44.015588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:44.017510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:44.018963 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a0763e61-a0b1-4ebd-9089-31c0818b5688 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.589116 Jun 04 09:28:44.019858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 131/270] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:43 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:44.027315 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-647c2ae7-5bdb-4129-b419-861c810a7ff1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:44.028384 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-647c2ae7-5bdb-4129-b419-861c810a7ff1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:44.035210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-169712e0-5e29-4df4-980e-e25f7edde1d0 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1245 microversion: 2.1 time: 0.208390 Jun 04 09:28:44.036161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 140/271] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:43 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1245 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:44.216557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-647c2ae7-5bdb-4129-b419-861c810a7ff1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:44.230931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-647c2ae7-5bdb-4129-b419-861c810a7ff1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1242 microversion: 2.1 time: 0.208967 Jun 04 09:28:44.235495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 132/272] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:44 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:44.850403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:44.851512 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:44.861035 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:44.861959 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:44.863324 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:44.864320 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.055697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:45.061022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:45.069927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.070690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.071704 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.072634 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.140009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.150826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9b6b4dd3-d3a3-4dd2-ad08-d739afe979ae tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.304467 Jun 04 09:28:45.160344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 141/273] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:44 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:45.180741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:45.187997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:45.207701 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.208582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.211863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.212641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.402623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.416735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.424193 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.426126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8f0e841a-67d6-4795-869e-0a8fd61ce481 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.380373 Jun 04 09:28:45.431130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 133/274] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:45 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:45.437177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:45.441633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:45.458713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.475165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.475383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8bdb9912-b6cd-477e-b232-ae6c915f56af tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1249 microversion: 2.1 time: 0.312224 Jun 04 09:28:45.476172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.476430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 142/275] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:45 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1249 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:45.477595 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:45.478474 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:45.594658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:45.610491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a9000d4e-0b5f-46bb-b263-eeb5cef2586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1246 microversion: 2.1 time: 0.177207 Jun 04 09:28:45.611582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 134/276] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:45 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1246 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:46.182809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:46.185029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:46.193220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.193669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.194445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.194888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.352722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.362900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bbbcf526-98a3-4fbc-9428-f085e7ff204e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.187828 Jun 04 09:28:46.363497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 143/277] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:46 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:46.449541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:46.450175 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:46.456749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.457199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.457985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.458419 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.501400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:46.502016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:46.508806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.509245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.510013 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.510504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.597031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.626891 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7e2f4583-5605-4253-a8a9-497ff587c6d5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1249 microversion: 2.1 time: 0.127229 Jun 04 09:28:46.628435 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 144/278] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:46 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:46.637182 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:46.637999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:46.645538 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.645995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.647127 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:46.647574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:46.730327 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.762146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.769482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.770391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:46.773661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-10cc052c-ada6-48ca-9c11-b8c99216a8ba tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.328205 Jun 04 09:28:46.775152 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 135/279] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:46 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:46.784173 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f22f2bca-6176-4380-9783-0fb484482033 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1246 microversion: 2.1 time: 0.152047 Jun 04 09:28:46.785110 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 145/280] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:46 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1246 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:47.385364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:47.387280 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:47.401440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.402156 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.403301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.404022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.615496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:47.624871 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2912c338-c7dd-4d8f-856a-6b4465394190 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1724 microversion: 2.1 time: 0.246879 Jun 04 09:28:47.625891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 136/281] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:47 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:47.685645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:47.686575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:47.698184 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.699729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.702035 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.703034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.802050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:47.804380 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:47.828065 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.828558 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.829395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.835000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.859436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:47.869063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cfde3fc6-031b-4ab8-804b-aeb181dc7030 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1249 microversion: 2.1 time: 0.206529 Jun 04 09:28:47.879077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 146/282] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:47 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1249 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:47.887697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:47.889820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:47.900940 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.901397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:47.902275 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:47.902715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:48.040760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:48.061598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2d24d02-75b8-4b41-8421-e4c7accf019d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1246 microversion: 2.1 time: 0.178227 Jun 04 09:28:48.063540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 147/283] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:47 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1246 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:48.107108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:48.118726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:48.120794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:48.122491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-230ced5c-bdc5-4194-94bd-34fa1527fb9f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.324638 Jun 04 09:28:48.123869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 137/284] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:47 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:48.643481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:48.644754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:48.658363 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:48.660242 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:48.662408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:48.664772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:48.890783 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:48.891546 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:48.915160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:48.915611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:48.931042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:48.931921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:48.985753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.026137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2e76a9c8-74cc-45d8-8460-ca134a5c3494 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1701 microversion: 2.1 time: 0.385605 Jun 04 09:28:49.028131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 148/285] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:48 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1701 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:49.062923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-44d24c17-2d7c-40bb-97df-ec2d651eccaa tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:49.086714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44d24c17-2d7c-40bb-97df-ec2d651eccaa tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.088432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.093597 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44d24c17-2d7c-40bb-97df-ec2d651eccaa tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.099449 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c0d2c561-1ce3-4a1c-a978-eb70207975b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1297 microversion: 2.1 time: 0.214447 Jun 04 09:28:49.101361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 138/286] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:48 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1297 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:49.113889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:49.116781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:49.137371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.138789 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.140149 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.140822 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.252919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-44d24c17-2d7c-40bb-97df-ec2d651eccaa tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Going to try to start instance {{(pid=118477) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 09:28:49.263527 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.277703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-734f8a84-e78d-4b43-ae6b-ec3a8bef48cb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1294 microversion: 2.1 time: 0.170061 Jun 04 09:28:49.278300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 139/287] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:49 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1294 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:49.283319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:49.284169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:49.291731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.292463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.293422 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.294016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.540021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.565438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.577318 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:49.579979 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d1106306-d424-4eab-b3e5-1717d9cdfa38 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.300182 Jun 04 09:28:49.581466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 140/288] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:49 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:49.601255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-44d24c17-2d7c-40bb-97df-ec2d651eccaa tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action" status: 202 len: 0 microversion: 2.1 time: 0.546874 Jun 04 09:28:49.605449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 149/289] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:28:49 2022] POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:28:49.639533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:49.644973 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:49.679710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.680922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:49.683126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:49.690068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.005004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:50.023025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ae8bab83-7984-42cd-9aba-ceb4673916b3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1710 microversion: 2.1 time: 0.415559 Jun 04 09:28:50.024259 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 141/290] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:49 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1710 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:50.129263 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:50.132134 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:50.148168 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.149043 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.151706 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.152690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.277656 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:50.300567 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:50.303392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:50.398427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-247f5ac0-9882-4089-9164-c677a271e60a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1305 microversion: 2.1 time: 0.199159 Jun 04 09:28:50.398427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 150/291] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:50 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:50.400849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.400849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.400849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.400849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.519049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:50.527226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cb03e822-da08-4535-b146-5f143c9caa27 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1294 microversion: 2.1 time: 0.234942 Jun 04 09:28:50.528022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 142/292] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:50 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:50.606407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:50.607004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:50.614145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.614768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.615581 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:50.616016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:50.978912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:50.985025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:50.992084 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:50.999842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:51.012078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c2dc1bf5-5cad-4b0f-a046-7db3d99b62d3 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.399067 Jun 04 09:28:51.012078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 151/293] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:50 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:51.045930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:51.046550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:51.057954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.058773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.061380 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.062219 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.431702 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:51.436542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:51.451461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.452929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.458362 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.461879 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.522437 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:51.560513 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77429d12-04b9-4668-a0e3-015ac221fb1d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1710 microversion: 2.1 time: 0.518836 Jun 04 09:28:51.566054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 143/294] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:51 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1710 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:51.577563 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:51.578373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:51.586796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.587410 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.588454 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:51.589061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:51.595801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:51.728958 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:51.746212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2ca89717-466e-4a13-ad5f-4eb68091f5d8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1303 microversion: 2.1 time: 0.333327 Jun 04 09:28:51.760913 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 152/295] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:51 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1303 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:51.787382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:51.796855 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c8aefb4b-e7b0-4358-bb9c-495837323f56 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1312 microversion: 2.1 time: 0.232950 Jun 04 09:28:51.797900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 144/296] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:51 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:52.024865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:52.026440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:52.038233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.039403 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.041204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.042337 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.551072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:52.581678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:52.581678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:52.583748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b5fd5c75-f066-4d97-aca9-29c6c7c9e623 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.566278 Jun 04 09:28:52.585892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:52.586993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:52.587576 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 153/297] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:52 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:52.605433 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.605925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.609182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.609801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.779593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:52.780411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:52.789225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:52.791888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.792649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.793673 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:52.794280 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:52.943910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:52.953366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:52.969737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1453f72e-8324-40de-af7c-0e773c4c0058 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1710 microversion: 2.1 time: 0.390465 Jun 04 09:28:52.989465 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 145/298] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:52 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1710 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:52.998020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:52.999167 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:53.014650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:53.017389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:53.017389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:53.017698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:53.068664 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:53.078441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-70f72673-763b-4a6b-851a-2ab1f2873d76 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.303020 Jun 04 09:28:53.079388 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:53.080099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 154/299] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:52 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:53.126313 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:53.134189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-412fd650-361c-4d7d-90d7-ad6b898abe3a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1312 microversion: 2.1 time: 0.142699 Jun 04 09:28:53.135375 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 146/300] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:52 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:53.607581 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:53.609858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:53.625489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:53.626388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:53.627900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:53.628881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:53.862158 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:53.878874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:53.881808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:53.883892 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dc978bf9-45d6-409f-a891-5cf082e0669c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.283747 Jun 04 09:28:53.885048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 155/301] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:53 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:53.999211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:54.000334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:54.009004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.009476 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:54.010295 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.010735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:54.103409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:54.104034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:54.106060 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=12 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:54.126116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.130551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:54.130551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.130551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:54.233448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=12 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:28:54.946258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:54.961843 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9234905a-b4b1-4f6c-9938-671c4be4b305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1710 microversion: 2.1 time: 0.968548 Jun 04 09:28:54.962483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 147/302] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:53 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1710 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:54.967700 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:54.968384 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:54.976639 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.976829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:54.977614 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:54.978230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:55.006810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:55.026348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1c196e04-0628-49fe-b4e7-7b84bbb738dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.931913 Jun 04 09:28:55.037780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 156/303] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:54 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:55.043910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:55.045554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:55.059718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:55.059718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:55.059718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:55.061171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:55.283805 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:55.316516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c17ae697-61d8-4e35-91af-b63c678d266d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1312 microversion: 2.1 time: 0.352743 Jun 04 09:28:55.317071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 148/304] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:54 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:55.651200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:55.667209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:55.670722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:55.676400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-edacf0bb-340b-4cc7-a1d7-e2edbd559ffc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.642457 Jun 04 09:28:55.677941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 157/305] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:55 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:28:56.007074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:56.008984 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:56.041495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.042384 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.043010 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.043453 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.050658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:56.064461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:56.091735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.097935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.099536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.106391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.570887 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:56.585019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3313ce5d-54fa-4269-8e26-aa8bc7eb5947 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1714 microversion: 2.1 time: 0.605601 Jun 04 09:28:56.586055 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 149/306] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:55 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1714 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:56.595745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:56.596607 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:56.609419 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.610221 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.610473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:56.611805 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.612688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.620180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3b315e1a-69c6-4790-886d-f798f2fbc556 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.577298 Jun 04 09:28:56.631177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 158/307] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:56 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:56.699725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:56.701240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:56.712786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.713836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.715167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:56.715809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:56.744307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:56.765450 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1e92539f-55df-4e33-9012-6b974948771a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1300 microversion: 2.1 time: 0.177602 Jun 04 09:28:56.776999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 150/308] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:56 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:28:57.021709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-bc75334f-3e8c-4883-ba53-7d982b5ae5df req-17d2e3da-6b8d-4ce8-95ca-f47d2d526702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:28:57.057309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-bc75334f-3e8c-4883-ba53-7d982b5ae5df req-17d2e3da-6b8d-4ce8-95ca-f47d2d526702 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:57.061857 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-bc75334f-3e8c-4883-ba53-7d982b5ae5df req-17d2e3da-6b8d-4ce8-95ca-f47d2d526702 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:57.076799 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-bc75334f-3e8c-4883-ba53-7d982b5ae5df req-17d2e3da-6b8d-4ce8-95ca-f47d2d526702 service nova] Creating event network-changed:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:28:57.082630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:57.083438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-bc75334f-3e8c-4883-ba53-7d982b5ae5df req-17d2e3da-6b8d-4ce8-95ca-f47d2d526702 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078278 Jun 04 09:28:57.088638 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 151/309] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:28:57.109934 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:57.114992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:57.117552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a280aacf-2923-4709-bb04-64b854ee2757 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1736 microversion: 2.20 time: 0.424618 Jun 04 09:28:57.118890 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 159/310] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:56 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1736 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:28:57.641367 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:57.642576 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:57.652921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:57.654268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:57.655416 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:57.656017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:57.795311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:57.795813 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:57.803227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:57.803688 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:57.804540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:57.804992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:59.053989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:59.057955 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:59.074404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-922aeeae-f7d5-4755-99a6-d723b2bce0d7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 1.438872 Jun 04 09:28:59.098676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 152/311] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:57 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:59.098903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ad5e8a7b-9e6f-4d2d-ae00-3988045a8dc0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 1.283825 Jun 04 09:28:59.098903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 160/312] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:28:57 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:28:59.099177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:28:59.099177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:28:59.107803 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:59.112932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:59.112932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:28:59.112932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:28:59.556905 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:59.578109 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:59.581236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:28:59.583467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-840ede2e-0c1f-4305-aaba-1ac3db392191 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1718 microversion: 2.20 time: 0.506485 Jun 04 09:28:59.584900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 153/313] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:28:59 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1718 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:00.126711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:00.127807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:00.134694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:00.135753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:00.152641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.156865 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.159409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.170872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.172105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.172105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.172780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.172780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.877061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:00.885456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cddffb38-67b4-4b8d-b201-cf55b2f4d979 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.782102 Jun 04 09:29:00.895469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 154/314] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:00 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:00.897741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:00.900664 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:00.901334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:00.909815 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.910277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.911072 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.911512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.912615 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cedc9b6b-352f-4826-9d59-006d7afd85a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.806613 Jun 04 09:29:00.913669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 161/315] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:00 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:00.923034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-60e2d47c-bffe-41ca-bc24-0f079896a005 req-26d3d954-172d-45f1-91d0-82407b11e07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40117894-5b54-4a57-9b6c-b0e8a3dc0af3", "tag": "fe242bec-d45c-40d4-afab-a95ae8f9f83f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:00.938925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-60e2d47c-bffe-41ca-bc24-0f079896a005 req-26d3d954-172d-45f1-91d0-82407b11e07d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:00.939816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-60e2d47c-bffe-41ca-bc24-0f079896a005 req-26d3d954-172d-45f1-91d0-82407b11e07d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:00.961335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-60e2d47c-bffe-41ca-bc24-0f079896a005 req-26d3d954-172d-45f1-91d0-82407b11e07d service nova] Creating event network-changed:fe242bec-d45c-40d4-afab-a95ae8f9f83f for instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 on hv-cinder-84469 Jun 04 09:29:00.984587 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-60e2d47c-bffe-41ca-bc24-0f079896a005 req-26d3d954-172d-45f1-91d0-82407b11e07d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068732 Jun 04 09:29:00.985626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 162/316] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:01.086451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:01.096810 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:01.098351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:01.099679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bfc16d36-b1f3-4523-b207-a3942eb51db5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1718 microversion: 2.20 time: 0.203070 Jun 04 09:29:01.101200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 155/317] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:00 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1718 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:01.903994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:01.904803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:01.912239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:01.912723 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:01.913544 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:01.913985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:01.931973 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:01.932850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:01.941351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:01.953508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:01.953508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:01.953508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:02.511056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:02.517913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:02.521749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-080549f1-a028-4d60-a6cd-de3d1b943ecd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.622567 Jun 04 09:29:02.522892 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 163/318] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:01 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:02.528725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a6ec54b5-6394-4dc5-a900-6c3ca34cb2dc tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.600791 Jun 04 09:29:02.539477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 156/319] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:01 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:02.539641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:02.539641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:02.539798 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-2452c02b-12ce-4b02-bc82-e6c144259b7f req-cc5e15c8-e747-4fcd-9ea4-3a8bbc8ca790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:02.540998 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:02.541642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:02.542871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:02.543375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:02.544547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-2452c02b-12ce-4b02-bc82-e6c144259b7f req-cc5e15c8-e747-4fcd-9ea4-3a8bbc8ca790 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:02.544997 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-2452c02b-12ce-4b02-bc82-e6c144259b7f req-cc5e15c8-e747-4fcd-9ea4-3a8bbc8ca790 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:02.558923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-2452c02b-12ce-4b02-bc82-e6c144259b7f req-cc5e15c8-e747-4fcd-9ea4-3a8bbc8ca790 service nova] Creating event network-vif-unplugged:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:29:02.565528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-2452c02b-12ce-4b02-bc82-e6c144259b7f req-cc5e15c8-e747-4fcd-9ea4-3a8bbc8ca790 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034308 Jun 04 09:29:02.566445 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 157/320] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:02.727153 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:02.736316 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:02.738226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:02.739506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a78b9f8f-ee42-4642-8edf-f28eb69a2c9d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1718 microversion: 2.20 time: 0.214408 Jun 04 09:29:02.740079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 164/321] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:02 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1718 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:03.548874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:03.549632 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:03.554038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:03.556263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:03.556995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.557500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.558296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.558736 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.568428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.569241 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.570724 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.571519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.770542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:03.780101 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-98999848-b64c-40f8-bc5e-736820b48901 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.235130 Jun 04 09:29:03.780741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 165/322] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:03 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:03.785806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:03.786422 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:03.792855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.793306 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.794644 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:03.795256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:03.820894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:03.829453 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cebef1f4-fd55-4390-b16f-19b20629e971 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.283893 Jun 04 09:29:03.835869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 158/323] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:03 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:04.097479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:04.126523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:04.133016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:04.136759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a6bc203f-e526-46f9-89c1-f6f1f5920212 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1721 microversion: 2.20 time: 0.354197 Jun 04 09:29:04.138834 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 166/324] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:03 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:04.161776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "600c0bd0-0db7-42bc-82d7-ce190d25b4ab"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:04.163945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:04.178326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:04.184031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:04.184031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:04.184031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:04.807997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:04.808667 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:04.817911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:04.818420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:04.819325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:04.819767 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:04.980670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:04.989662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1f1567ea-0133-4d8e-bac2-b78270d439f4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.185939 Jun 04 09:29:04.990266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 167/325] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:04 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:05.006524 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:05.007494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:05.014533 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:05.014987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:05.016100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:05.016578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:05.185354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:05.194887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6b6cc866-b3de-48a1-bb2d-b8ed9922cb77 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.203402 Jun 04 09:29:05.196933 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 168/326] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:04 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:05.601787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:05.702914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c2bf4b24-21f4-4dc0-ae09-081739c97b97 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.550096 Jun 04 09:29:05.703553 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 159/327] 10.222.0.46 () {62 vars in 1363 bytes} [Sat Jun 4 09:29:04 2022] POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments => generated 188 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:29:05.869444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:05.870334 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:05.878058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:05.878674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:05.879735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:05.880260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:05.883409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:06.016247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:06.017293 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:06.028744 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.030033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.031758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.033257 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.219097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cbd8c7a2-2476-4a96-bbbf-0cd89ca0ea99 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/action" status: 202 len: 0 microversion: 2.20 time: 0.354981 Jun 04 09:29:06.227807 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 169/328] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jun 4 09:29:05 2022] POST /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:29:06.242225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:06.243801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:06.252611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:06.265237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aef6009e-3750-4614-9e30-4c8d351ce035 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.258465 Jun 04 09:29:06.274210 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 160/329] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:06 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:06.274436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.274436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.274436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.274857 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.283921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:06.286588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:06.294957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.295790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.307214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:06.307214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:06.533862 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:06.542205 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4217eb1f-7122-432b-ba31-6d5074b12f73 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.311732 Jun 04 09:29:06.542807 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 170/330] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:06 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:06.546944 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:06.566390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:06.572526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:06.572526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-60d44306-fc88-4346-82bf-3b3ab0d06e48 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1747 microversion: 2.20 time: 0.293387 Jun 04 09:29:06.572526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 161/331] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:06 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1747 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:07.283474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:07.288512 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:07.295154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.295969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.297754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.298664 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.505591 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:07.516880 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8601b336-9e65-448c-91c6-de777cf6f549 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.237102 Jun 04 09:29:07.518169 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 171/332] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:07 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:07.559357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:07.560272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:07.562587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:07.567876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.568364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.569162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.569610 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.594933 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:07.596145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:07.606959 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.612954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.613999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:07.614512 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:07.853113 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:07.867139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f16bf249-7f09-4816-8747-0de3317e7d7a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.311198 Jun 04 09:29:07.871777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:07.873260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 162/333] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:07 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:07.881651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:07.883452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:07.884839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0e85c874-3f02-4277-94c5-37e16d181ad7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1747 microversion: 2.20 time: 0.297584 Jun 04 09:29:07.885808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 172/334] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:07 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1747 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:08.518569 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-efd284aa-422e-4957-92e7-19d0454db056 req-72a48f0e-2d5f-4c55-8a0f-e66f3ebe565d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "name": "network-vif-plugged", "status": "completed", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:08.532402 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-efd284aa-422e-4957-92e7-19d0454db056 req-72a48f0e-2d5f-4c55-8a0f-e66f3ebe565d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.533210 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-efd284aa-422e-4957-92e7-19d0454db056 req-72a48f0e-2d5f-4c55-8a0f-e66f3ebe565d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.535556 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:08.536467 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:08.544357 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.544755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.546007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.546296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.554929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-efd284aa-422e-4957-92e7-19d0454db056 req-72a48f0e-2d5f-4c55-8a0f-e66f3ebe565d service nova] Creating event network-vif-plugged:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:29:08.567061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-efd284aa-422e-4957-92e7-19d0454db056 req-72a48f0e-2d5f-4c55-8a0f-e66f3ebe565d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051161 Jun 04 09:29:08.569375 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 163/335] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:08.754238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:08.768798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2d6a0c6a-09bb-49f6-a230-07492d029a43 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.236741 Jun 04 09:29:08.769831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 173/336] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:08 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:08.899486 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:08.900790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:08.915429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:08.920595 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.921337 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.923069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.923069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.934317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:08.961319 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.962234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:08.963221 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:08.966712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:09.278440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:09.286341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8ab37216-ea19-48a5-bc5b-19bf50f8e2b5 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.394737 Jun 04 09:29:09.286936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 164/337] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:08 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:09.291795 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:09.304522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:09.306098 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:09.307311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3aa3ab96-327d-42ab-ab34-ba5905502c76 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1749 microversion: 2.20 time: 0.406307 Jun 04 09:29:09.307904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 174/338] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:08 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1749 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:09.786937 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:09.787700 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:09.794797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:09.795246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:09.796039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:09.796507 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:09.941218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:09.949855 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-90990342-98ac-4dfc-963d-91961ce15053 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.166779 Jun 04 09:29:09.950475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 165/339] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:09 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:10.307824 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:10.308952 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:10.317393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.319387 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.327692 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.328340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.329050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:10.329787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:10.336823 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.338896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.338896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.338896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.650420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:10.655734 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:10.660605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04d70af5-09bf-4177-a779-856686177601 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1370 microversion: 2.1 time: 0.357362 Jun 04 09:29:10.661206 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 175/340] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:10 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:10.670380 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:10.673670 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:10.676030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-18c5972e-1a6d-4f78-a04a-f17976459c3d tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1749 microversion: 2.20 time: 0.351829 Jun 04 09:29:10.677124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 166/341] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:10 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1749 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:10.767322 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e30c0000-bf60-4953-a158-e0fe779cb3d3 req-d68085a0-5480-4c08-bae7-1139af76a219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40117894-5b54-4a57-9b6c-b0e8a3dc0af3", "name": "network-vif-plugged", "status": "completed", "tag": "fe242bec-d45c-40d4-afab-a95ae8f9f83f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:10.776935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e30c0000-bf60-4953-a158-e0fe779cb3d3 req-d68085a0-5480-4c08-bae7-1139af76a219 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.777711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e30c0000-bf60-4953-a158-e0fe779cb3d3 req-d68085a0-5480-4c08-bae7-1139af76a219 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.792398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e30c0000-bf60-4953-a158-e0fe779cb3d3 req-d68085a0-5480-4c08-bae7-1139af76a219 service nova] Creating event network-vif-plugged:fe242bec-d45c-40d4-afab-a95ae8f9f83f for instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 on hv-cinder-84469 Jun 04 09:29:10.802194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e30c0000-bf60-4953-a158-e0fe779cb3d3 req-d68085a0-5480-4c08-bae7-1139af76a219 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037761 Jun 04 09:29:10.803811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 176/342] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:29:10.979493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:10.979493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:10.985589 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.986678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:10.988106 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:10.988907 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:11.217967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:11.231162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fcd82ed0-28ee-4624-889c-489714c282f2 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.265986 Jun 04 09:29:11.232174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 167/343] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:10 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:11.700349 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:11.701819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:11.708722 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:11.714260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:11.716273 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:11.717585 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:11.719395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:11.720245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:11.726603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:11.727412 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:11.729627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:11.729627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:12.077792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:12.088475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:12.090036 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:12.097657 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ebe50352-ef39-40eb-8c36-fe47fe62e2a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1749 microversion: 2.20 time: 0.392911 Jun 04 09:29:12.098025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:12.098326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 168/344] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:11 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1749 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:12.100590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b110eb1f-d94d-467f-8a33-872300772b16 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1565 microversion: 2.1 time: 0.410370 Jun 04 09:29:12.101194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 177/345] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:11 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1565 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:12.118844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:12.119461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:12.128025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:12.128514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:12.129351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:12.129787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:12.221118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77e817fb-20ec-41d0-979b-4590be05d12b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106572 Jun 04 09:29:12.221791 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 169/346] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:29:12 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:12.252118 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:12.253285 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:12.262783 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:12.263473 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:12.264661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:12.267358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:12.522288 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:12.538549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-58e54e4a-519a-43c8-86eb-025df409cf1d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.290959 Jun 04 09:29:12.543655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 178/347] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:12 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:13.116099 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:13.117243 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:13.127747 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:13.128547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:13.129936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:13.130691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:13.311992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:13.321801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:13.323353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:13.325209 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3fa59196-1c8f-4b39-a0e7-c2288913950f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.217488 Jun 04 09:29:13.325791 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 170/348] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:13 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:13.561323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:13.561927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-9987cd3a-9f31-47ff-8b74-9af5849f2b1f req-42136697-d85d-43c6-84de-f70a1b271b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:13.568749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:13.578254 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9987cd3a-9f31-47ff-8b74-9af5849f2b1f req-42136697-d85d-43c6-84de-f70a1b271b9c service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:13.579075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9987cd3a-9f31-47ff-8b74-9af5849f2b1f req-42136697-d85d-43c6-84de-f70a1b271b9c service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:13.583344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:13.584616 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:13.587029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:13.588137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:13.599631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-9987cd3a-9f31-47ff-8b74-9af5849f2b1f req-42136697-d85d-43c6-84de-f70a1b271b9c service nova] Creating event network-changed:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:29:13.605915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-9987cd3a-9f31-47ff-8b74-9af5849f2b1f req-42136697-d85d-43c6-84de-f70a1b271b9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052384 Jun 04 09:29:13.606737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 171/349] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:13.819120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:13.828989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-27917248-bbbf-408d-8c3d-001ecc5bf32c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1368 microversion: 2.1 time: 0.275637 Jun 04 09:29:13.829522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 179/350] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:13 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:29:14.355079 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:14.358466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:14.366909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:14.367490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:14.368440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:14.368867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:14.857989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:14.860088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:14.874996 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:14.876438 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:14.878205 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:14.879367 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:15.045475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:15.054955 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:15.056525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:15.059906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ad3f691b-1ce8-4255-aad9-bd1d2e383675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.716660 Jun 04 09:29:15.059906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 172/351] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:14 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:15.402329 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:15.410515 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3c8c2493-12d9-44c0-a6a0-ce58e1744185 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1559 microversion: 2.1 time: 0.565921 Jun 04 09:29:15.411107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 180/352] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:14 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1559 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:15.433307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:15.434190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:15.445204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:15.445967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:15.447357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:15.448107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:15.607287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-729da17c-8513-4d5d-9748-59465eb4d6a3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180726 Jun 04 09:29:15.616469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 173/353] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:29:15 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:16.076940 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:16.078196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:16.085997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:16.086604 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:16.087665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:16.088180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:16.308630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:16.324013 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:16.326462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:16.328977 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-557e3f74-7940-41b8-ade4-505c4b4777ae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.256408 Jun 04 09:29:16.330292 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 181/354] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:16 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:17.356170 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:17.357536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:17.365544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:17.366284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:17.367420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:17.368047 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:17.626042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-03757607-5830-4711-b8b7-33bc20901197 req-54b21194-f397-47ee-91ea-22d94cca9490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40117894-5b54-4a57-9b6c-b0e8a3dc0af3", "tag": "fe242bec-d45c-40d4-afab-a95ae8f9f83f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:17.646704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-03757607-5830-4711-b8b7-33bc20901197 req-54b21194-f397-47ee-91ea-22d94cca9490 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:17.647977 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-03757607-5830-4711-b8b7-33bc20901197 req-54b21194-f397-47ee-91ea-22d94cca9490 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:17.663561 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:17.675127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:17.676818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:17.678320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fc8e033d-62e9-40ee-80fc-0898c3c01edc tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.326946 Jun 04 09:29:17.691007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 174/355] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:17 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:17.695099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-03757607-5830-4711-b8b7-33bc20901197 req-54b21194-f397-47ee-91ea-22d94cca9490 service nova] Creating event network-changed:fe242bec-d45c-40d4-afab-a95ae8f9f83f for instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 on hv-cinder-84469 Jun 04 09:29:17.706136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-03757607-5830-4711-b8b7-33bc20901197 req-54b21194-f397-47ee-91ea-22d94cca9490 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090748 Jun 04 09:29:17.708063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 182/356] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:18.697983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:18.699306 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:18.707815 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:18.708694 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:18.709800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:18.710472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:18.908619 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:18.921404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:18.930397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:18.932010 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-14763799-4f3f-4e5a-944f-7d2f12219942 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.237629 Jun 04 09:29:18.959559 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 175/357] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:18 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:19.974607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:19.975406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:19.984150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:19.984771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:19.985925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:19.986452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:20.218887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:20.230324 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:20.232001 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:20.233349 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-91a6a548-ff31-45e6-bcb3-1d7414bb1d61 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.263084 Jun 04 09:29:20.235808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 183/358] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:19 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:21.253354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:21.262796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:21.265403 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:21.265994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:21.267806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:21.268687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:21.483371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:21.494642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:21.496185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:21.497381 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-99168105-a3a8-4d07-bc02-8e2f50c7f458 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.248199 Jun 04 09:29:21.497955 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 176/359] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:21 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:22.525236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:22.526944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:22.534162 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:22.534611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:22.535617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:22.536051 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:22.720710 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:22.731159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:22.732791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:22.734155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-39373c53-7fe1-47bb-bc9b-acfdd8788d17 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.214049 Jun 04 09:29:22.735277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 184/360] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:22 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:23.758777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:23.762481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:23.779442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:23.782233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:23.782233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:23.782729 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:24.001107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:24.027154 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:24.032651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:24.032651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d0d138b1-5d1d-4b05-9188-6346cf02f12a tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.279509 Jun 04 09:29:24.032651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 177/361] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:23 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:25.057849 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:25.058514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:25.062280 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=64 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:25.070097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:25.070811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:25.071779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:25.072968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:25.282600 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:25.291990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:25.293631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:25.294896 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2e278bc-8283-41f8-935c-9faa168df6be tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.241429 Jun 04 09:29:25.295474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 185/362] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:25 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:26.315438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:26.316610 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:26.324847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:26.325404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:26.326342 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:26.326830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:26.332443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=98 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:26.563311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:26.579838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:26.583230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:26.585486 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-47ce12b4-5e8f-4fb9-93bb-7d4ff903ac42 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.274258 Jun 04 09:29:26.586425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 178/363] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:26 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:27.609945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:27.610619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:27.618152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:27.618650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:27.619499 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:27.620071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:27.623328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:27.769427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:27.779235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:27.781170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:27.782747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-57c1f8ca-2dfc-43ca-94dd-a26d75708525 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.177039 Jun 04 09:29:27.783416 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 186/364] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:27 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:28.802409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:28.803359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:28.811421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:28.811421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:28.812074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:28.812557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:29.053774 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:29.063719 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:29.065239 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:29.066440 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5816e41b-9e6e-4a58-a7d6-d2bc2fa6b512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.268615 Jun 04 09:29:29.067003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 179/365] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:28 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:30.087571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:30.088231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:30.095578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:30.096065 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:30.096887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:30.097325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:30.249345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:30.259100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:30.261458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:30.262909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-95bc2f84-d17b-4ae6-bea9-5613c1af84d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.179927 Jun 04 09:29:30.263635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 187/366] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:30 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:31.287371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:31.288448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:31.296748 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:31.297266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:31.298205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:31.298815 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:31.454142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:31.465893 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:31.467521 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:31.468785 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8fdbf3b9-a778-4306-9b28-12876960b8db tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.185899 Jun 04 09:29:31.469601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 180/367] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:31 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:32.489518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:32.490517 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:32.497990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:32.498571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:32.499562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:32.500090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:32.653143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:32.667357 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:32.670204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:32.672615 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a47cc550-0d36-4d70-a47d-3a42770114a1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.188109 Jun 04 09:29:32.673597 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 188/368] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:32 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:33.692526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:33.693160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:33.700438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:33.700894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:33.701681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:33.702117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:33.846572 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:33.856245 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:33.857806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:33.859233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3b2de4d5-3e77-4923-bb3f-b77b43f4334b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.171149 Jun 04 09:29:33.859801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 181/369] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:33 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:34.878275 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:34.878919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:34.886591 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:34.887092 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:34.887931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:34.888460 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:35.035974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:35.045360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:35.046916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:35.048125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3eb85b01-fa2d-4a9a-bc93-6c4bf3134cc0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.174063 Jun 04 09:29:35.048743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 189/370] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:34 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:36.067013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:36.067672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:36.074265 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:36.074788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:36.075740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:36.076319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:36.226421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:36.236942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:36.238542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:36.239786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-24ed5888-dd74-407c-af65-f89bad35d7b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.177018 Jun 04 09:29:36.240409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 182/371] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:36 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:37.268937 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:37.269767 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:37.276742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:37.277200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:37.277990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:37.278559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:37.466080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:37.475421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:37.476873 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:37.478671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9012681a-5f73-4f6a-ae37-8538013610df tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.213745 Jun 04 09:29:37.479258 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 190/372] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:37 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:38.499418 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:38.504429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:38.504429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=42 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:38.509195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:38.509865 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:38.510993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:38.511597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:38.888890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:38.898543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:38.900759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:38.901969 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7bba5ffe-aec3-4bc8-b1fa-75384327a08b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.407483 Jun 04 09:29:38.902582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 183/373] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:38 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:39.920170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:39.920874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:39.927800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:39.928251 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:39.929075 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:39.929559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:40.086068 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:40.096010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:40.097672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:40.098889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-502c63db-fdb4-429d-b2ba-c923167e956f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.182634 Jun 04 09:29:40.099459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 191/374] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:39 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:40.486126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-85a4f42c-3a8e-44df-a660-0b10906a5bdc req-2f9ff0b4-d699-46a2-9217-7560d0d978b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "name": "network-vif-plugged", "status": "completed", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:40.495389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-85a4f42c-3a8e-44df-a660-0b10906a5bdc req-2f9ff0b4-d699-46a2-9217-7560d0d978b5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:40.495947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-85a4f42c-3a8e-44df-a660-0b10906a5bdc req-2f9ff0b4-d699-46a2-9217-7560d0d978b5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:40.510408 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-85a4f42c-3a8e-44df-a660-0b10906a5bdc req-2f9ff0b4-d699-46a2-9217-7560d0d978b5 service nova] Creating event network-vif-plugged:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:29:40.517709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-85a4f42c-3a8e-44df-a660-0b10906a5bdc req-2f9ff0b4-d699-46a2-9217-7560d0d978b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035593 Jun 04 09:29:40.519235 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 184/375] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:29:41.118038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:41.118929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:41.126115 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:41.126573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:41.131070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:41.131070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:41.302806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:41.313709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:41.315467 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:41.316791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e5179fe3-051a-404c-8128-879b8997a517 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.202786 Jun 04 09:29:41.317371 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 192/376] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:41 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:42.337256 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:42.338713 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:42.345562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:42.346016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:42.347511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:42.347511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:42.496539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:42.505790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:42.507344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:42.509177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d385edec-4f89-43b0-b536-1535f68c79a0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.177109 Jun 04 09:29:42.509755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 185/377] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:42 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:29:43.528925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:43.529756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:43.536485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:43.536950 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:43.537773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:43.538199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:43.696654 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:43.706474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:43.707966 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:43.709171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6671455b-8fdf-4837-af3a-c19e8905f646 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1805 microversion: 2.20 time: 0.184338 Jun 04 09:29:43.709764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 193/378] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:43 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1805 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:44.732099 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:44.732890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:44.743144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:44.743896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:44.745249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:44.745983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:44.951585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:44.963489 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:44.965912 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:44.967571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a93cd0b8-8f9a-47fa-b326-1119852ce5af tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1792 microversion: 2.20 time: 0.241799 Jun 04 09:29:44.968532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 186/379] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:29:44 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1792 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:29:53.189347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:53.190225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:53.202328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:53.202930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:53.203936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:53.204520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:53.356462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lazy-loading 'services' on Instance uuid ffde7de1-13e8-4ea6-98d2-d07a19afee2e {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:29:53.652633 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9d9d53b0-7f41-416d-a171-57fb3d0b8416 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments/43e4310f-0a69-46e4-a17d-c33a7e93de32" status: 202 len: 0 microversion: 2.1 time: 0.470463 Jun 04 09:29:53.653626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 194/380] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:29:53 2022] DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments/43e4310f-0a69-46e4-a17d-c33a7e93de32 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:29:57.988064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3caa43b2-16e1-4cec-95b9-59e4a2cd8065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:29:57.991253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=7 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:57.992118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=48 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:57.998187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3caa43b2-16e1-4cec-95b9-59e4a2cd8065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:58.004858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3caa43b2-16e1-4cec-95b9-59e4a2cd8065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:58.051229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3caa43b2-16e1-4cec-95b9-59e4a2cd8065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Going to try to stop instance {{(pid=118476) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 09:29:58.371614 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3caa43b2-16e1-4cec-95b9-59e4a2cd8065 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action" status: 202 len: 0 microversion: 2.1 time: 0.387197 Jun 04 09:29:58.372264 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 187/381] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:29:57 2022] POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:29:58.381540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:58.382436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:58.384979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=20 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:29:58.391240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:58.391692 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:58.392530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:58.392975 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:58.549408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:58.556023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e1dcea5-a19e-4001-a5ec-137462c3c20e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.178825 Jun 04 09:29:58.556753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 195/382] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:58 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:29:59.582551 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:29:59.583266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:29:59.590263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:59.590711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:59.591526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:29:59.591980 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:29:59.769534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:29:59.783740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f27ccc9d-2b27-488b-817b-de612bf99520 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.205527 Jun 04 09:29:59.784703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 188/383] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:29:59 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:00.804052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:00.805092 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:00.812895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:00.813470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:00.814359 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:00.814884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:00.818116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:00.961701 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:00.970221 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49a53939-9cb0-4723-b44e-07dd5b561165 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.170825 Jun 04 09:30:00.970815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 196/384] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:00 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:01.988001 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:01.988718 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:01.995334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:01.995783 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:01.996624 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:01.997085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:02.162640 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:02.172781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8fef996-a360-4836-abae-eb0f137aee64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.188780 Jun 04 09:30:02.173762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 189/385] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:01 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:03.198197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:03.199133 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:03.206843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:03.207433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:03.208264 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:03.208948 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:03.368984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:03.382953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bce644f4-d3ee-485f-be6a-9551682fdebf tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.188666 Jun 04 09:30:03.384036 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 197/386] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:03 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:04.401011 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:04.401693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:04.408271 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:04.408748 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:04.409530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:04.409960 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:04.563784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:04.572956 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-edb6af38-7dde-471c-998c-012f4fc9c305 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.176005 Jun 04 09:30:04.573539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 190/387] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:04 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:05.593790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:05.594849 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:05.605772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:05.606745 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:05.607994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:05.608734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:05.766876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:05.774842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f7ff4d08-6438-481a-9356-14f626a3f0b1 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.187617 Jun 04 09:30:05.775440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 198/388] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:05 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:06.792521 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:06.793173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:06.800090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:06.800570 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:06.801359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:06.801796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:06.976569 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:06.991594 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ae07af01-f537-4b89-bacd-276b7e4c7d16 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.202260 Jun 04 09:30:06.994278 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 191/389] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:06 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:08.022978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:08.024031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:08.034896 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:08.035664 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:08.037183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:08.037924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:08.207209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:08.215584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-21439a51-3ca8-4e7f-ac57-55f0f995d984 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.200580 Jun 04 09:30:08.216179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 199/390] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:08 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:09.051938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95297221-26e9-4393-b563-ef9f7f28babe"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:09.054047 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:09.060892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:09.061429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:09.062248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:09.062843 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:09.239287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:09.241257 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:09.258358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:09.258974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:09.260754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:09.261314 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:09.437018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:09.451252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1589e802-3f59-46d6-8a21-1481e9e933a5 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.220307 Jun 04 09:30:09.452321 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 200/391] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:09 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:10.239512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1a508f67-7741-48ee-9a1d-26318c5e63eb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.191344 Jun 04 09:30:10.240150 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 192/392] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:30:09 2022] POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments => generated 194 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:10.478934 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:10.479650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:10.487079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:10.487632 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:10.488505 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:10.488977 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:10.674028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:10.682746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e3d26401-4f96-414a-815d-ca7388ae881b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.208015 Jun 04 09:30:10.683348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 201/393] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:10 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:11.710036 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:11.710539 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:11.723117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:11.723904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:11.725589 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:11.726166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:11.986875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:11.998651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-88e621f3-faef-46a3-9230-af2d57c2c22a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1678 microversion: 2.1 time: 0.300495 Jun 04 09:30:11.999531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 193/394] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:11 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:13.018021 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:13.018660 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:13.025795 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:13.026298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:13.027139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:13.027625 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:13.179278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:13.187617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ce23d835-db81-499e-b932-49b55b4d23d3 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1655 microversion: 2.1 time: 0.173474 Jun 04 09:30:13.188216 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 202/395] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:13 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:13.205022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a817d2e1-1191-4b82-8421-150be38c63e9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:13.212581 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a817d2e1-1191-4b82-8421-150be38c63e9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:13.213033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a817d2e1-1191-4b82-8421-150be38c63e9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:13.240411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a817d2e1-1191-4b82-8421-150be38c63e9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Going to try to start instance {{(pid=118476) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 09:30:13.461627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a817d2e1-1191-4b82-8421-150be38c63e9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action" status: 202 len: 0 microversion: 2.1 time: 0.259795 Jun 04 09:30:13.462972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 194/396] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:30:13 2022] POST /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:30:13.473483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:13.474580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:13.482295 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:13.482734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:13.483543 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:13.483983 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:13.651435 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:13.665905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2e925e0e-d633-43bd-80bc-f8aaef46db64 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1664 microversion: 2.1 time: 0.196997 Jun 04 09:30:13.666997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 203/397] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:13 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1664 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:14.028903 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:14.029498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:14.036236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.037237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.038204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.038649 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.066479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eb1e657d-1dd9-4d27-9e39-f363a47daf7c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/ips" status: 200 len: 151 microversion: 2.1 time: 0.042235 Jun 04 09:30:14.067085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 195/398] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:30:14 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:14.082837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c93e30e-bcd2-44d1-b91b-1251bf8a13d3"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:14.084747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:14.092980 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.093323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.094123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.094563 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.219556 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/os-volume_attachments HTTP/1.1 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 74 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:30:14.221440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {"volumeAttachment": {"volumeId": "2c93e30e-bcd2-44d1-b91b-1251bf8a13d3"}} Jun 04 09:30:14.227786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': '40117894-5b54-4a57-9b6c-b0e8a3dc0af3', 'body': {'volumeAttachment': {'volumeId': '2c93e30e-bcd2-44d1-b91b-1251bf8a13d3'}}} Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:14.229733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:14.232916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 400 to user: Invalid volume: volume 2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 is already attached to instances: 63c900d7-98de-4ba9-a6d7-98bc2194c582 {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-def31f24-bf8d-4e11-9ff2-a4bc90668608 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.144640 Jun 04 09:30:14.235623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 204/399] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:30:14 2022] POST /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 09:30:14.238790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:14.239576 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:14.246344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.246872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.247681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.248132 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.297644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:30:14.661108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e6aca755-abe7-43e2-be18-784a1707ef8e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 204 len: 0 microversion: 2.1 time: 0.430405 Jun 04 09:30:14.662370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 196/400] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:30:14 2022] DELETE /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:30:14.672602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:14.673344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:14.682996 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.683536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.684571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.685143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.686402 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:14.687414 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:14.695792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.696330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.697232 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:14.697844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:14.926557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:14.933253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:14.939585 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6633b95c-8faf-4703-8088-94c025872d84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1684 microversion: 2.1 time: 0.271897 Jun 04 09:30:14.940590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 205/401] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:14 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1684 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:14.947759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-825f4908-ea54-4c35-8f3e-2901aee0a9c4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1664 microversion: 2.1 time: 0.266277 Jun 04 09:30:14.948876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 197/402] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:14 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1664 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:15.966285 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:15.967186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:15.971282 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:15.972538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:15.977600 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:15.978368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:15.979727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:15.980780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:15.984975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:15.985524 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:15.986467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:15.987134 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:16.240465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:16.246721 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:16.249442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-471c937b-daf7-45fa-a221-0a4cd115a1e7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1684 microversion: 2.1 time: 0.287829 Jun 04 09:30:16.250305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 206/403] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:15 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1684 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:16.253838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:16.260365 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-517363d8-c604-4181-8a0d-bc3b3e59647e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1664 microversion: 2.1 time: 0.294365 Jun 04 09:30:16.269912 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 198/404] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:15 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:17.288188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:17.288961 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:17.293858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:17.295334 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:17.302994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:17.306987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:17.307588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:17.308563 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:17.309276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:17.310215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:17.310735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:17.315636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:17.717132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:17.738388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db562d1e-94a6-40d5-afee-a7fe0d6da2b6 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1684 microversion: 2.1 time: 0.466341 Jun 04 09:30:17.740465 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:17.752183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 207/405] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:17 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1684 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:17.757198 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1b312968-a6ec-4622-b142-49952db5b1c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1668 microversion: 2.1 time: 0.472995 Jun 04 09:30:17.774999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 199/406] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:17 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1668 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:18.692572 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-0629e6eb-be22-4f76-bd4b-26b2ecd91639 req-b8185f84-6be6-4d1c-a1ca-716ca37066b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40117894-5b54-4a57-9b6c-b0e8a3dc0af3", "name": "network-vif-deleted", "tag": "fe242bec-d45c-40d4-afab-a95ae8f9f83f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:18.711058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0629e6eb-be22-4f76-bd4b-26b2ecd91639 req-b8185f84-6be6-4d1c-a1ca-716ca37066b5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:18.711752 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0629e6eb-be22-4f76-bd4b-26b2ecd91639 req-b8185f84-6be6-4d1c-a1ca-716ca37066b5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:18.733429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-0629e6eb-be22-4f76-bd4b-26b2ecd91639 req-b8185f84-6be6-4d1c-a1ca-716ca37066b5 service nova] Creating event network-vif-deleted:fe242bec-d45c-40d4-afab-a95ae8f9f83f for instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 on hv-cinder-84469 Jun 04 09:30:18.741185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-0629e6eb-be22-4f76-bd4b-26b2ecd91639 req-b8185f84-6be6-4d1c-a1ca-716ca37066b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055096 Jun 04 09:30:18.742527 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 208/407] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:18.778264 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:18.779499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:18.792523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:18.793057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:18.793936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:18.794503 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:18.898774 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:18.908229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-de36e979-fd9b-4264-9357-7c4aeeb6ce76 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 200 len: 1616 microversion: 2.1 time: 0.135801 Jun 04 09:30:18.909684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 200/408] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:18 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 1616 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:19.014930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:19.017355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:19.029602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:19.030261 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:19.032207 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:19.033042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:19.079343 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'flavor' on Instance uuid d387fd90-a667-4aa4-a900-db1a4708a0fc {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:19.578357 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ab25a66c-0b25-4127-94d2-1b0201f74a53 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/action" status: 200 len: 32 microversion: 2.1 time: 0.573297 Jun 04 09:30:19.584244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 209/409] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:30:19 2022] POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/action => generated 32 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:30:19.595162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:19.596826 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:19.611804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:19.612666 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:19.615039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:19.616107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:19.935049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:19.953808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c68895cc-4184-4832-b926-0f11b7dd068b tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.367558 Jun 04 09:30:19.954641 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 201/410] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:19 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:19.964845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:19.965670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:19.997456 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:19.998274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:20.004856 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:20.006277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:20.035360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 HTTP/1.1 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:30:20.039498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:30:20.042377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '40117894-5b54-4a57-9b6c-b0e8a3dc0af3'} Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:20.043219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:30:20.052724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:20.054850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:20.054850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4b30bc9b-4336-463d-8c81-0e5aacc5f34e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 404 len: 111 microversion: 2.1 time: 0.113789 Jun 04 09:30:20.054850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 210/411] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:19 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:30:20.062465 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7db1f21b-575c-4e9b-9d35-d22826f4e3d8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '.version_select at 0x7fa415ea6160>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:20.174905 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7db1f21b-575c-4e9b-9d35-d22826f4e3d8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982247592" status: 202 len: 0 microversion: 2.1 time: 0.119003 Jun 04 09:30:20.191834 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 202/412] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jun 4 09:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982247592 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:30:20.986806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:20.988064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:21.002003 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:21.002871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:21.004571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:21.006030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:21.202317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:21.217331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-12cbf0fd-7385-43ed-9890-8f9d4c97c194 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.238166 Jun 04 09:30:21.218747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 211/413] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:20 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:21.570385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:21.571215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:21.579366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:21.579932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:21.580973 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:21.581479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:21.720122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'services' on Instance uuid 63c900d7-98de-4ba9-a6d7-98bc2194c582 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:21.987014 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c785d967-8396-47a6-8bac-b168f1503347 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments/2c93e30e-bcd2-44d1-b91b-1251bf8a13d3" status: 202 len: 0 microversion: 2.1 time: 0.421989 Jun 04 09:30:21.987683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 203/414] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:30:21 2022] DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments/2c93e30e-bcd2-44d1-b91b-1251bf8a13d3 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:30:22.002788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:22.006430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:22.017299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:22.017931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:22.018947 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:22.019649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:22.023131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:22.077137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fcb1a63a-23b4-4da7-a44f-a314d778661f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082089 Jun 04 09:30:22.078070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 212/415] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:30:21 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:22.236144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:22.236918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:22.245063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:22.245672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:22.246630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:22.247111 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:22.396896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:22.405716 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3df6a5e9-e43d-47bf-9e4b-780de29e1ad6 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.173967 Jun 04 09:30:22.406323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 204/416] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:22 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:23.094019 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:23.095481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:23.106107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:23.106756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:23.108088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:23.109107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:23.148998 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c8c1da57-aa3f-4960-b108-d1828e7511e0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060014 Jun 04 09:30:23.148998 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 213/417] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:30:23 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:23.426452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:23.427121 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:23.435040 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:23.435773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:23.437409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:23.437692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:23.640575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:23.656432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2df05f43-ec88-43b8-b9ec-56375f189b1c tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.235328 Jun 04 09:30:23.657442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 205/418] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:23 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:24.160552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:24.161571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:24.170270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.170759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.171588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.172029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.212816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f32a6ce7-4f7e-4308-bafb-5f34d62cde0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056722 Jun 04 09:30:24.213418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 214/419] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:30:24 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 09:30:24.285606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:24.287172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:24.294391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.294836 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.295632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.296069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.325761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:30:24.681779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:24.682393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:24.689997 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.693038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.693038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.693365 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0298cf38-d206-4a2d-9311-ba35bca9759a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 204 len: 0 microversion: 2.1 time: 0.409759 Jun 04 09:30:24.693951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.694494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 206/420] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:30:24 2022] DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:30:24.704571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:24.705463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:24.713856 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.714447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.715390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:24.716011 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:24.897489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:24.908144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ee435e18-d26f-47fc-bb1e-02a86a384b3f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.230602 Jun 04 09:30:24.909080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 215/421] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:24 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:24.930769 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:24.942952 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eb496bba-146e-4939-8267-ca51b661c7ac tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1680 microversion: 2.1 time: 0.242599 Jun 04 09:30:24.943906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 207/422] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:24 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:25.928001 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:25.928886 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:25.935741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:25.936196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:25.937025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:25.937463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:25.970773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:25.971859 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:25.985740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:25.986597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:25.988451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:25.990459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:26.171017 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:26.182929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-22408df9-fc72-4aba-bde4-92dc1f930163 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.259186 Jun 04 09:30:26.183679 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 216/423] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:25 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:26.202189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:26.211280 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-be42d8a5-e58f-4632-aa94-6363255afb23 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1680 microversion: 2.1 time: 0.244695 Jun 04 09:30:26.211883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 208/424] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:25 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:26.653217 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:26.653715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:26.660319 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:26.661048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:26.661877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:26.662271 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:26.694669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cea222e0-2785-4e2d-8c0d-bd6a53bbb9ad tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments/600c0bd0-0db7-42bc-82d7-ce190d25b4ab" status: 200 len: 194 microversion: 2.20 time: 0.046042 Jun 04 09:30:26.695293 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 217/425] 10.222.0.46 () {60 vars in 1453 bytes} [Sat Jun 4 09:30:26 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments/600c0bd0-0db7-42bc-82d7-ce190d25b4ab => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:30:26.769915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:26.771446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:26.782495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:26.783295 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:26.784800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:26.796966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:26.910721 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lazy-loading 'services' on Instance uuid 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:27.200005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-12daf4f9-4d84-437b-b1a7-0ba11773a871 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments/600c0bd0-0db7-42bc-82d7-ce190d25b4ab" status: 202 len: 0 microversion: 2.20 time: 0.437000 Jun 04 09:30:27.205417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 209/426] 10.222.0.46 () {60 vars in 1456 bytes} [Sat Jun 4 09:30:26 2022] DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments/600c0bd0-0db7-42bc-82d7-ce190d25b4ab => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:30:27.212042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:27.213214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:27.214578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:27.215696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:27.226691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.227509 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.228593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.229243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.229500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.230381 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.231764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.232592 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.272062 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-388c83e9-edce-4f8e-a5db-f29474e33e92 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064498 Jun 04 09:30:27.273096 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 210/427] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jun 4 09:30:27 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:30:27.279045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:27.279681 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:27.287458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.287819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.288500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.288939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.435791 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:27.448439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-748018d6-ea67-4a31-b60f-d08b0cbf3649 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1612 microversion: 2.1 time: 0.174068 Jun 04 09:30:27.453959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 211/428] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:27 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1612 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:27.718652 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:27.732743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fcc6a546-c0c2-43c7-bf39-ab801c0079b3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.525100 Jun 04 09:30:27.733650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 218/429] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:27 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:27.938702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-f8a9ca19-725a-4590-b31d-d549c450337d req-36d5bbda-3ca1-4da2-93a1-1bac3c8bd17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c900d7-98de-4ba9-a6d7-98bc2194c582", "name": "network-vif-deleted", "tag": "edfbce93-3cd9-4178-ab5b-64cba09aa8ad"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:27.952005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-f8a9ca19-725a-4590-b31d-d549c450337d req-36d5bbda-3ca1-4da2-93a1-1bac3c8bd17f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:27.952491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-f8a9ca19-725a-4590-b31d-d549c450337d req-36d5bbda-3ca1-4da2-93a1-1bac3c8bd17f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:27.969223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-f8a9ca19-725a-4590-b31d-d549c450337d req-36d5bbda-3ca1-4da2-93a1-1bac3c8bd17f service nova] Creating event network-vif-deleted:edfbce93-3cd9-4178-ab5b-64cba09aa8ad for instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 on hv-cinder-84469 Jun 04 09:30:27.973796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-f8a9ca19-725a-4590-b31d-d549c450337d req-36d5bbda-3ca1-4da2-93a1-1bac3c8bd17f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042213 Jun 04 09:30:27.978738 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 212/430] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:28.287956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:28.289675 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:28.299738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.300281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.301198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.302268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.336917 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9f274800-4e72-4bb1-9f9b-437032f8dcb8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056369 Jun 04 09:30:28.337641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 219/431] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jun 4 09:30:28 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:30:28.468494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:28.470755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:28.471711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:28.477904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.478451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.479322 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.480398 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.514710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.515159 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.515612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'fault' on Instance uuid 63c900d7-98de-4ba9-a6d7-98bc2194c582 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:28.564212 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:28.569237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:28.577804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f3978a91-46dd-4aa4-b594-744a92457885 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 200 len: 1330 microversion: 2.1 time: 0.113905 Jun 04 09:30:28.593076 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 213/432] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:28 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:28.751995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:28.753144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:28.766304 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.766777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.767611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:28.768247 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:28.952968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:28.979402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-52838adc-e2ff-4355-a5a9-bb644cdc3d91 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.231606 Jun 04 09:30:28.980686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 220/433] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:28 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:29.353936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:29.356744 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:29.367238 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.367684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.368575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.369013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.429949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8960b5b1-efc0-43cf-8416-0a7006d38c03 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083610 Jun 04 09:30:29.431351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 214/434] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jun 4 09:30:29 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:29.511025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:29.511839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:29.520937 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.521294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.522096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.522536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.553462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:30:29.609833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:29.610837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:29.624103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.624886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.626111 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:29.626788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:29.649928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 HTTP/1.1 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:30:29.656501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:30:29.658946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '63c900d7-98de-4ba9-a6d7-98bc2194c582'} Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:29.660358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:30:29.663456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:29.665684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:29.665684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b887451e-5983-492f-93a0-4c81c01eb073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 404 len: 111 microversion: 2.1 time: 0.054022 Jun 04 09:30:29.665684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 215/435] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:29 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:30:29.670664 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ee60a913-3cc3-4b8a-9c0a-7db492f57ff3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '.version_select at 0x7fa415ea19d0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:29.824867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ee60a913-3cc3-4b8a-9c0a-7db492f57ff3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601581030" status: 202 len: 0 microversion: 2.1 time: 0.160751 Jun 04 09:30:29.825740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 216/436] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jun 4 09:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601581030 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:30:29.987281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d963c641-12a0-4b49-93a6-d40bde563b11 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 204 len: 0 microversion: 2.20 time: 0.480044 Jun 04 09:30:29.988240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 221/437] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jun 4 09:30:29 2022] DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 09:30:29.998701 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:29.999339 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:30.000759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:30.001801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:30.007043 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:30.007652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:30.008653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:30.009143 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:30.011405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:30.012104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:30.013790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:30.014618 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:30.242686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:30.254943 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ef1f2106-9ab7-4d05-bfcc-778b882a124f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.259561 Jun 04 09:30:30.255939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 217/438] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:29 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:30.258383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:30.273327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:30.277919 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:30.281394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-061a2a21-35bb-46ca-8d05-5fa1253de847 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.285868 Jun 04 09:30:30.282893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 222/439] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:29 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:30.927105 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-45dcfb1f-a667-45c8-9c2c-b97a68e1a4c1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: .version_select at 0x7fa415d73dc0>, body: {"keypair": {"name": "tempest-keypair-1423717385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Xwyb2I81TKppcoi76UJHqxXhfWXowX4yFO3c07bvgSCfd7lT1r5FTZNUY4OsqCTKMdDH68PrYdDG31W6TQj+Ch4LDntjJeG6BSB1RHhnjlyKaKvzkvlFwKxeM8RcAjg=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:30.942429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-45dcfb1f-a667-45c8-9c2c-b97a68e1a4c1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:30:30.947137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-45dcfb1f-a667-45c8-9c2c-b97a68e1a4c1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:30:31.040376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-45dcfb1f-a667-45c8-9c2c-b97a68e1a4c1 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117548 Jun 04 09:30:31.041053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 218/440] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:30:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:31.287317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:31.287317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:31.287317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:31.291090 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:31.291803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:31.293263 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:31.294100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:31.303662 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:31.304320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:31.311027 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:31.317391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:31.317391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:31.317391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:31.648669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:31.653828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:31.663784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:31.664388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-842af092-f554-4ecd-9002-475db9c9fcba tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.394145 Jun 04 09:30:31.665386 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:31.665561 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 223/441] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:31 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:31.667068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-defbb602-e240-4a4b-97cc-307c4b298251 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1720 microversion: 2.20 time: 0.367412 Jun 04 09:30:31.680377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 219/442] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:31 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1720 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:30:32.695861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:32.697291 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:32.698916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:32.700408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:32.708034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:32.709044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:32.710335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:32.711022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:32.716303 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:32.717208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:32.718749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:32.719554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:32.809162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:32.821601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:32.823780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:32.825732 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c2a42cde-7ac7-4a60-9cd0-cf62f9982ce2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1653 microversion: 2.20 time: 0.134951 Jun 04 09:30:32.831781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 220/443] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:32 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1653 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:33.212661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:33.230605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c810d62b-e929-492e-ae20-3c4382dc0d8a tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.542423 Jun 04 09:30:33.231069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 224/444] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:32 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:33.401214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-d5828ef3-5665-419f-9cab-f13890da23e7 req-a064515a-2d3f-44fd-8c70-f78b10ebe429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61c71590-e9f8-4f50-a859-a54c2f2d0ae2", "name": "network-vif-deleted", "tag": "9a1e5e6d-b9f7-4c8b-942a-0a36feecf027"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:33.415992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d5828ef3-5665-419f-9cab-f13890da23e7 req-a064515a-2d3f-44fd-8c70-f78b10ebe429 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:33.417242 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d5828ef3-5665-419f-9cab-f13890da23e7 req-a064515a-2d3f-44fd-8c70-f78b10ebe429 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:33.444466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-d5828ef3-5665-419f-9cab-f13890da23e7 req-a064515a-2d3f-44fd-8c70-f78b10ebe429 service nova] Creating event network-vif-deleted:9a1e5e6d-b9f7-4c8b-942a-0a36feecf027 for instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 on hv-cinder-84469 Jun 04 09:30:33.455788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-d5828ef3-5665-419f-9cab-f13890da23e7 req-a064515a-2d3f-44fd-8c70-f78b10ebe429 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060788 Jun 04 09:30:33.461918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 221/445] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:33.854635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:33.855861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:33.869155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:33.869839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:33.870662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:33.871108 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:33.915588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:33.916328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:33.916968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lazy-loading 'fault' on Instance uuid 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:33.975155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:33.986922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:33.991340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:33.999149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2fd4b9f-3702-41f7-a1fa-e8150e0da11f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 200 len: 1370 microversion: 2.20 time: 0.152729 Jun 04 09:30:34.000874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 225/446] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:33 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:34.260142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:34.261594 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:34.270744 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:34.271194 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:34.272024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:34.272703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:34.506235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-611697833", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72d5f400-ff54-4f35-902d-3289af4496b7"}], "security_groups": [{"name": "tempest-securitygroup--552385309"}], "key_name": "tempest-keypair-1423717385", "user_data": "}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:34.577471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:34.595206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-196a6a37-c783-494b-afea-eda72408ec0d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.338813 Jun 04 09:30:34.600790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 222/447] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:34 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:34.693125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] validate_networks() for [('72d5f400-ff54-4f35-902d-3289af4496b7', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:30:35.031481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:35.032488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:35.045159 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.046577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.048345 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.049425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.078113 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 HTTP/1.1 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:30:35.088163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:30:35.091013 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '61c71590-e9f8-4f50-a859-a54c2f2d0ae2'} Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:35.092426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:30:35.094473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:35.100270 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:35.102415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-de2c6670-7e99-4739-ae6a-59c9e885d5a9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 404 len: 111 microversion: 2.20 time: 0.077659 Jun 04 09:30:35.103890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 223/448] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:35 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:30:35.125549 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1cac78ed-0a22-41da-8754-8cc343545514 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '.version_select at 0x7fa415ea19d0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:35.262861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:30:35.263520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:30:35.272024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:30:35.272024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:30:35.272024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:30:35.287477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.288613 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.290143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.291071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.296764 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1cac78ed-0a22-41da-8754-8cc343545514 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787807369" status: 204 len: 0 microversion: 2.20 time: 0.183389 Jun 04 09:30:35.310446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 224/449] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Jun 4 09:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787807369 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 09:30:35.319477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:30:35.328532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:30:35.351570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:30:35.354310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:30:35.547641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5f7ac637-a8f5-4c5b-aded-8c62a9357f8f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.049653 Jun 04 09:30:35.548963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 226/450] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:30:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 09:30:35.567458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ac08e825-5c5e-4070-8d20-599cdd4acd90 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:35.569073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ac08e825-5c5e-4070-8d20-599cdd4acd90 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:35.629909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:35.630911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:35.641398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.642122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.643481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:35.644247 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:35.675006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:35.801509 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ac08e825-5c5e-4070-8d20-599cdd4acd90 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:35.873302 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ac08e825-5c5e-4070-8d20-599cdd4acd90 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1241 microversion: 2.1 time: 0.305805 Jun 04 09:30:35.895374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 225/451] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:35 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1241 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:36.097045 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:36.118398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4b03cbf1-f02f-4b3f-b746-730613539a69 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.494040 Jun 04 09:30:36.119480 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 227/452] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:35 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:36.600721 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2c5ff0d6-e93d-412f-ba64-36bc932e6082 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: .version_select at 0x7fa415ea6b80>, body: {"keypair": {"name": "tempest-keypair-469374808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvJk5MWv09WEXKJYQUd2QxkF1GcPcVoyDKPb4pXxpGTMM6EfG78Nm/DSezADvHZXG9NXKAUaE7PVG/Mf0I/RldVWJZH9VHO6HE//Hu30UXp3XDbECkysU0Eg2g0s+4MSA=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:36.634169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-2c5ff0d6-e93d-412f-ba64-36bc932e6082 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for project 0cf07261800e47938626f61a1fb73b2b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:30:36.642367 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-2c5ff0d6-e93d-412f-ba64-36bc932e6082 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for user 7b6676edfa984008b846589b2df9ef92 and project 0cf07261800e47938626f61a1fb73b2b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:30:36.772743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2c5ff0d6-e93d-412f-ba64-36bc932e6082 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.182433 Jun 04 09:30:36.773483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 226/453] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Jun 4 09:30:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 09:30:36.902905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e17183a-c7e5-4ac8-8664-42e184d73670 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:36.903684 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e17183a-c7e5-4ac8-8664-42e184d73670 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:36.974564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e17183a-c7e5-4ac8-8664-42e184d73670 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:36.987715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e17183a-c7e5-4ac8-8664-42e184d73670 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1241 microversion: 2.1 time: 0.088697 Jun 04 09:30:36.988880 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 228/454] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:36 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:37.137880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:37.138662 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:37.147448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:37.148144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:37.149474 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:37.150425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:37.315527 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:37.324494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-639afc3a-ed8b-40f5-925f-7b37c540e66d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.190629 Jun 04 09:30:37.325086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 227/455] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:37 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:38.008245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:38.009102 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:38.017051 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:38.017494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:38.018584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:38.019022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:38.122294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:38.131778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e14a699-b749-4592-98b9-391b334de604 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1237 microversion: 2.1 time: 0.127583 Jun 04 09:30:38.137504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 229/456] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:38 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:38.346570 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:38.348320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:38.358896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:38.361417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:38.361417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:38.361417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:38.616497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:38.631851 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-16dc24d4-475e-4846-a98b-3ffcccdb6af8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1736 microversion: 2.1 time: 0.291185 Jun 04 09:30:38.632870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 228/457] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:38 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:39.151042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:39.152072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:39.159535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:39.160014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:39.161734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:39.162499 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:39.260085 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:39.278171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-46367cae-a1c5-4fa7-b51b-16176a77f520 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1301 microversion: 2.1 time: 0.130467 Jun 04 09:30:39.279314 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 230/458] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:39 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:39.660904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:39.663211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:39.675972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:39.676811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:39.678424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:39.679233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:39.986093 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:40.000058 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1fd65dac-69fe-4806-bb9e-4e132c616d7e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1716 microversion: 2.1 time: 0.347366 Jun 04 09:30:40.008366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 229/459] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:39 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1716 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:40.165306 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:40.167124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:40.182061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.183270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.185042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.185817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.197927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-794553389", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a96e2986-096a-4e28-a2fd-b426bbfcf78d"}], "security_groups": [{"name": "tempest-securitygroup--1016852670"}], "key_name": "tempest-keypair-469374808", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:40.328598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] HTTP exception thrown: Cannot 'detach_volume' instance d387fd90-a667-4aa4-a900-db1a4708a0fc while it is in vm_state rescued Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Request method failure captured: Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments/95297221-26e9-4393-b563-ef9f7f28babe HTTP/1.1 Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVHcosoWg4BkQ3m39Jw8redzlOM5ZqGfaRM5DyEYeFsJFrwbLK94TPaWAP4jk1gXl_fXNWbXw7HbRrztESHYfXZfSdysapX2P3MsRkFWlYGzC_0Scq47em5ewBvkKym0v4zc_7k710Vza6mw7MzipJj2JZWhvYc0Q2c7HKkVFD6NSI Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:30:40.330918 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e42983d2d3964b8cb5d32e6d653d6dfd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 34a7ef6d33b141ce8fb1cec517faffd1 Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:30:40.334177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Cannot 'detach_volume' instance d387fd90-a667-4aa4-a900-db1a4708a0fc while it is in vm_state rescued Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': 'd387fd90-a667-4aa4-a900-db1a4708a0fc', 'id': '95297221-26e9-4393-b563-ef9f7f28babe'} Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:40.335678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d387fd90-a667-4aa4-a900-db1a4708a0fc while it is in vm_state rescued Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d387fd90-a667-4aa4-a900-db1a4708a0fc while it is in vm_state rescued Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:30:40.338405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Returning 409 to user: Cannot 'detach_volume' instance d387fd90-a667-4aa4-a900-db1a4708a0fc while it is in vm_state rescued {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:40.341157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-03d6f128-e8a2-4a56-b386-f4a4e159ba1e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments/95297221-26e9-4393-b563-ef9f7f28babe" status: 409 len: 152 microversion: 2.1 time: 0.176212 Jun 04 09:30:40.341157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 231/460] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:30:40 2022] DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments/95297221-26e9-4393-b563-ef9f7f28babe => generated 152 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 09:30:40.345999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:40.346777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:40.355798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.361333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.361333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.361333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.395922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] validate_networks() for [('a96e2986-096a-4e28-a2fd-b426bbfcf78d', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:30:40.497825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:40.509879 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-35ceb7c1-fa94-419b-a216-7cc42940ea87 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1299 microversion: 2.1 time: 0.168140 Jun 04 09:30:40.510952 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 232/461] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:40 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:40.518373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:40.524217 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:40.527718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.528360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.530177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.530948 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.865554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9d2ebe1f-07c9-4329-b73f-fd4a58e6b959 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/action" status: 202 len: 0 microversion: 2.1 time: 0.352841 Jun 04 09:30:40.866395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 233/462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:30:40 2022] POST /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:30:40.881970 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:40.883794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:40.894885 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.895526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:40.896768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:40.896981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:41.460075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:30:41.460937 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:30:41.461329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:30:41.462052 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:30:41.462605 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:30:41.463423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:41.472747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8a784ad3-4cca-4d77-931d-ca9562a4ed19 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1724 microversion: 2.1 time: 0.600492 Jun 04 09:30:41.475514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:41.476500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:41.477966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:41.479200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:41.485751 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 234/463] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:40 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1724 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:41.505154 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for project 0cf07261800e47938626f61a1fb73b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:30:41.511221 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Getting quotas for user 7b6676edfa984008b846589b2df9ef92 and project 0cf07261800e47938626f61a1fb73b2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:30:41.526661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:30:41.529376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:30:41.533582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:41.534239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:41.542346 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:41.543262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:41.544576 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:41.545274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:41.667698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0bf3c9ef-d9b6-4cf2-93ea-fad698e86521 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.474593 Jun 04 09:30:41.673270 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 230/464] 10.222.0.46 () {62 vars in 1187 bytes} [Sat Jun 4 09:30:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 04 09:30:41.694579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:41.695787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:41.837779 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:41.854445 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:41.857030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:41.858811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9be799ec-fec3-44c4-a7ef-139ca2d6a03e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1280 microversion: 2.20 time: 0.176855 Jun 04 09:30:41.859575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:41 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:41.893598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:41.908753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-82a7212e-5916-4b42-86cf-b2f6f8ab64a7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.379268 Jun 04 09:30:41.910366 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 235/466] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:41 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:42.492581 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:42.493425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:42.500817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.501383 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:42.502251 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.502766 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:42.793103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:42.807001 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-54b96189-7fe5-4aae-87f8-c09df2a7b363 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1724 microversion: 2.1 time: 0.317648 Jun 04 09:30:42.808123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 232/467] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:42 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:42.887825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:42.888599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:42.896541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.897113 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:42.898040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.898481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:42.936049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:42.938983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:42.953293 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.959186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:42.959186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:42.959186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:43.055421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:43.065197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:43.067700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:43.069108 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7fb223cc-b633-4bc7-86f2-6c17c510baa2 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1284 microversion: 2.20 time: 0.185541 Jun 04 09:30:43.070479 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 236/468] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:42 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:30:43.325756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:43.334226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ca781871-c51b-4f56-97c0-cc045c03c488 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.408599 Jun 04 09:30:43.334829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 233/469] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:42 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:43.564129 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-ed20cc2b-151b-41f9-8ff1-6d1a858efd75 req-50a68f7c-37ea-4de8-8ab0-7e60fa600397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd93bd20-00a2-47ab-ba82-3009fdfcf7c7", "tag": "7edf1bae-2245-49a6-877e-aff173928dd1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:43.581439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ed20cc2b-151b-41f9-8ff1-6d1a858efd75 req-50a68f7c-37ea-4de8-8ab0-7e60fa600397 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:43.582136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-ed20cc2b-151b-41f9-8ff1-6d1a858efd75 req-50a68f7c-37ea-4de8-8ab0-7e60fa600397 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:43.599057 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-ed20cc2b-151b-41f9-8ff1-6d1a858efd75 req-50a68f7c-37ea-4de8-8ab0-7e60fa600397 service nova] Creating event network-changed:7edf1bae-2245-49a6-877e-aff173928dd1 for instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 on hv-cinder-84469 Jun 04 09:30:43.608636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-ed20cc2b-151b-41f9-8ff1-6d1a858efd75 req-50a68f7c-37ea-4de8-8ab0-7e60fa600397 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052507 Jun 04 09:30:43.609907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 237/470] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:43.833268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:43.833842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:43.841495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:43.841949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:43.842749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:43.843195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:43.995903 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:44.009451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d3db7dd0-64de-454e-9ca5-24ecc6aaedc4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1724 microversion: 2.1 time: 0.179504 Jun 04 09:30:44.010410 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 234/471] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:43 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:44.092686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:44.093492 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:44.101401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:44.102029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:44.103021 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:44.103789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:44.214237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:44.225276 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:44.226827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:44.227975 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-65548c20-674a-43c9-9778-3bf5f388ddae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1284 microversion: 2.20 time: 0.140380 Jun 04 09:30:44.228865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 238/472] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:44 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:44.353644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:44.353644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:44.362017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:44.362525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:44.363396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:44.363904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:44.523752 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:44.531867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-01d904ca-8bea-48bd-bdf3-81edd7edd719 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.183728 Jun 04 09:30:44.532462 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 235/473] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:44 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:45.029298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:45.029298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:45.036425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.036911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.037774 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.038226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.248180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:45.249460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:45.259341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.260053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.261348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.261999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.297388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:45.309738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:45.315953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-373d984b-d62e-4006-9dfc-0a8adf8787e1 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1730 microversion: 2.1 time: 0.292186 Jun 04 09:30:45.317312 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 239/474] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:45 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1730 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:45.335459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:45.336007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:45.343380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.343844 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.344688 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.345132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.379809 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:45.389623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:45.391268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:45.392541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5ee2b663-fed0-4b23-9e2e-b7035c28cc3e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1332 microversion: 2.20 time: 0.148953 Jun 04 09:30:45.393131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 236/475] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:45 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:30:45.454235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-63283597-a2ee-415b-96f2-b6c41ad4caed tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122824 Jun 04 09:30:45.454853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 240/476] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:30:45 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:45.557995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:45.559034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:45.568435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.569114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:45.570554 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:45.571400 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:46.092307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:46.101091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b39e8fc4-056b-45d2-9763-f5c7d05c6ef7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.547349 Jun 04 09:30:46.101685 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 237/477] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:45 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:46.417594 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:46.418488 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:46.427434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:46.428010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:46.429072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:46.429759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:46.764603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:46.780082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:46.783288 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:46.785895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a4b44269-1802-406f-997c-3c15f5247971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1338 microversion: 2.20 time: 0.373019 Jun 04 09:30:46.786880 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 241/478] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:46 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1338 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:47.119449 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:47.121432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:47.133676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:47.134456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:47.135924 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:47.136745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:47.467662 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:47.477400 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d4d2f89e-b9cd-4e88-8b41-7351c5c7dfe5 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.361955 Jun 04 09:30:47.478589 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 238/479] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:47 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:47.561164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-f44cad6c-a504-4723-9f56-f1c86a252bee req-c525a951-284f-45d0-b43d-2300b3888cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:47.568437 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:47.580938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f44cad6c-a504-4723-9f56-f1c86a252bee req-c525a951-284f-45d0-b43d-2300b3888cab service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:47.582780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-f44cad6c-a504-4723-9f56-f1c86a252bee req-c525a951-284f-45d0-b43d-2300b3888cab service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:47.614170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-f44cad6c-a504-4723-9f56-f1c86a252bee req-c525a951-284f-45d0-b43d-2300b3888cab service nova] Creating event network-changed:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:30:47.623424 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-f44cad6c-a504-4723-9f56-f1c86a252bee req-c525a951-284f-45d0-b43d-2300b3888cab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069229 Jun 04 09:30:47.624758 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 242/480] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:47.818959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:47.822176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:47.837781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:47.838612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:47.840180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:47.841007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:47.850448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:47.972574 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:47.990008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:47.993374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:47.995553 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-af39a0d5-aca1-4641-843f-22833f35887b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1338 microversion: 2.20 time: 0.184584 Jun 04 09:30:47.996677 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 239/481] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:47 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1338 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:30:48.500964 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:48.501911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:48.511204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:48.511896 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:48.512959 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:48.513603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:48.936157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:48.951080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-efa39ef0-c5c9-4091-8dcc-b36c73f79818 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.457661 Jun 04 09:30:48.952124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 243/482] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:48 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:49.018053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:49.019370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:49.023229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:49.026972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:49.027543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:49.028628 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:49.029206 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:49.236131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:49.247631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:49.250957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:49.252810 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6ee5f385-d022-471f-98d6-a1daf9034fae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.239057 Jun 04 09:30:49.253831 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 240/483] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:49 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:49.648993 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-e62ca32d-f8df-4a3e-ba36-c682a90c7ad1 req-628b3afb-adb8-438b-b072-589d620c2a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:49.665766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e62ca32d-f8df-4a3e-ba36-c682a90c7ad1 req-628b3afb-adb8-438b-b072-589d620c2a33 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:49.666500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-e62ca32d-f8df-4a3e-ba36-c682a90c7ad1 req-628b3afb-adb8-438b-b072-589d620c2a33 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:49.680978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-e62ca32d-f8df-4a3e-ba36-c682a90c7ad1 req-628b3afb-adb8-438b-b072-589d620c2a33 service nova] Creating event network-changed:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:30:49.686624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-e62ca32d-f8df-4a3e-ba36-c682a90c7ad1 req-628b3afb-adb8-438b-b072-589d620c2a33 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044501 Jun 04 09:30:49.687804 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 244/484] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:49.981016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:49.982303 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:49.994596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:49.995349 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:49.996840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:49.999216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:50.282590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:50.284218 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:50.301382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:50.302243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:50.303943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:50.305024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:50.544021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:50.559117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e80acf98-55fc-470a-b623-1c9ebec9c073 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.587137 Jun 04 09:30:50.566377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 241/485] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:49 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:50.716049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:50.753063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:50.759553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:50.761882 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-67a89396-925a-4d7b-a234-6d89f75c4fa6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.484884 Jun 04 09:30:50.784631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 245/486] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:50 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:50.843189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:50.847276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:50.861223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:50.864209 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:50.865837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:50.867532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:50.937596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-25c59ef7-fde9-4fcc-9009-8380ea84a238 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103530 Jun 04 09:30:50.939461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 242/487] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:30:50 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:30:51.081172 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:51.084720 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:51.100168 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.100802 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.101884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.103894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.150640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:51.190502 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:30:51.584910 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:51.586258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:51.590382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:51.604677 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.605502 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.607124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.607946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.644711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-617d3fe9-1dc0-40a8-a772-f4d31f802aa7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 204 len: 0 microversion: 2.1 time: 0.569773 Jun 04 09:30:51.646540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 246/488] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:30:51 2022] DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:30:51.666006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:51.666877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:51.677753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.678614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.679869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.680668 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.847292 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=18 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:30:51.916828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:51.928905 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-53875434-7c52-4208-93eb-cc4b52e64fb4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.352180 Jun 04 09:30:51.932455 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 243/489] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:51 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:51.938922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-a23c78e8-7f26-4ea2-90ca-dc2a2c67e807 req-e3e8bcbc-aa54-44d9-8340-cc96cca37161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:51.950303 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-a23c78e8-7f26-4ea2-90ca-dc2a2c67e807 req-e3e8bcbc-aa54-44d9-8340-cc96cca37161 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.950756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-a23c78e8-7f26-4ea2-90ca-dc2a2c67e807 req-e3e8bcbc-aa54-44d9-8340-cc96cca37161 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.958347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:51.964356 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-a23c78e8-7f26-4ea2-90ca-dc2a2c67e807 req-e3e8bcbc-aa54-44d9-8340-cc96cca37161 service nova] Creating event network-changed:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:30:51.970079 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-a23c78e8-7f26-4ea2-90ca-dc2a2c67e807 req-e3e8bcbc-aa54-44d9-8340-cc96cca37161 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038789 Jun 04 09:30:51.970682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 244/490] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:51.973178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eb379795-1733-4535-bc36-67e677415e67 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1674 microversion: 2.1 time: 0.314474 Jun 04 09:30:51.974935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 247/491] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:51 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1674 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:51.979472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:51.980240 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:51.990473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.991133 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:51.992117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:51.992763 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:52.166439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:52.179352 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:52.182635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:52.184772 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1cfbba1e-2bff-42cd-b414-aa0b414179e9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.211844 Jun 04 09:30:52.185603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 245/492] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:51 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:52.956753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:52.957382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:52.966450 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:52.967127 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:52.968185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:52.968670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:52.993692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:52.996743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:53.008838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:53.009715 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:53.020003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:53.020612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:53.190819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:53.204754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9fc990fc-4482-4b25-bca1-4a64bec2e625 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.252714 Jun 04 09:30:53.205799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 248/493] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:52 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:53.215139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-1048d97c-d5fc-4f86-aa18-653dea85fe7e req-74e56f95-3995-41aa-b3d6-2c2f32c53ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd93bd20-00a2-47ab-ba82-3009fdfcf7c7", "name": "network-vif-plugged", "status": "completed", "tag": "7edf1bae-2245-49a6-877e-aff173928dd1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:53.233180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-1048d97c-d5fc-4f86-aa18-653dea85fe7e req-74e56f95-3995-41aa-b3d6-2c2f32c53ffb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:53.233981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-1048d97c-d5fc-4f86-aa18-653dea85fe7e req-74e56f95-3995-41aa-b3d6-2c2f32c53ffb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:53.255762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:53.256157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-1048d97c-d5fc-4f86-aa18-653dea85fe7e req-74e56f95-3995-41aa-b3d6-2c2f32c53ffb service nova] Creating event network-vif-plugged:7edf1bae-2245-49a6-877e-aff173928dd1 for instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 on hv-cinder-84469 Jun 04 09:30:53.262617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-1048d97c-d5fc-4f86-aa18-653dea85fe7e req-74e56f95-3995-41aa-b3d6-2c2f32c53ffb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054979 Jun 04 09:30:53.263991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 249/494] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:53.265438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2307d205-8654-484c-95ad-56b68051df53 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1674 microversion: 2.1 time: 0.275726 Jun 04 09:30:53.273658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:53.274923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:53.276927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 246/495] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:52 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:53.284240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:53.284963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:53.285921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:53.286495 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:53.530194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:53.545497 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:53.553869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:53.556023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-62c3f3b1-2a57-4ed1-b6e2-7c2eb04b6c10 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.290027 Jun 04 09:30:53.557061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 250/496] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:53 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:54.230298 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:54.232691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:54.244580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.246207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.246207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.247042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.287382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:54.289261 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:54.310656 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.311634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.313500 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.314315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.605644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:54.622784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-124d3f08-614f-4f86-8910-b500776e4391 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.400978 Jun 04 09:30:54.623854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 247/497] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:54 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:54.633679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:54.634668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:54.647336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.648265 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.649506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:54.649957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:54.802892 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:54.814883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1170d742-89a7-4f02-a48f-4af3c8237f9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1674 microversion: 2.1 time: 0.535322 Jun 04 09:30:54.816580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 251/498] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:54 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1674 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:55.231397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:55.244073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:55.246134 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:55.247424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1bd99a5a-52be-467d-b050-a4a25936a971 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.622108 Jun 04 09:30:55.248199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 248/499] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:54 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:55.661042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:55.662187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:55.677712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-f9e46e97-0657-48b3-b993-14301753ee90 req-75f60ca0-a8f1-4ee9-9a34-e34f6bbd1225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffde7de1-13e8-4ea6-98d2-d07a19afee2e", "name": "network-vif-deleted", "tag": "19828924-fa28-4424-9220-6e59b86934bf"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:55.696755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:55.699114 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:55.699321 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-f9e46e97-0657-48b3-b993-14301753ee90 req-75f60ca0-a8f1-4ee9-9a34-e34f6bbd1225 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:55.699685 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-f9e46e97-0657-48b3-b993-14301753ee90 req-75f60ca0-a8f1-4ee9-9a34-e34f6bbd1225 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:55.701457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:55.702489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:55.722308 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-f9e46e97-0657-48b3-b993-14301753ee90 req-75f60ca0-a8f1-4ee9-9a34-e34f6bbd1225 service nova] Creating event network-vif-deleted:19828924-fa28-4424-9220-6e59b86934bf for instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e on hv-cinder-84469 Jun 04 09:30:55.731401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-f9e46e97-0657-48b3-b993-14301753ee90 req-75f60ca0-a8f1-4ee9-9a34-e34f6bbd1225 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056798 Jun 04 09:30:55.731401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 249/500] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:30:55.856506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:55.858314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:55.872095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:55.877320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:55.879615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:55.879897 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:56.413603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:56.431304 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ebc9768d-0039-4453-8243-372cd9c43822 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1606 microversion: 2.1 time: 0.591260 Jun 04 09:30:56.449140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 250/501] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:55 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1606 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:56.449140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:56.449140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:56.458888 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:56.460306 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:56.462290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:56.463171 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:56.477334 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:56.506874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e4562e53-e016-4a9b-ad3a-701477a7e063 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1366 microversion: 2.1 time: 0.858903 Jun 04 09:30:56.522433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 252/502] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:55 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1366 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:56.718913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:56.741099 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:56.744593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:56.750994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-95b39b95-2e09-4c43-ba25-38601f0da146 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.312820 Jun 04 09:30:56.752754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 251/503] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:56 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:30:57.465168 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:57.467316 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:57.482079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.482888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.484062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.484956 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.534143 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:57.536456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:57.550603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.555177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.555177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lazy-loading 'fault' on Instance uuid ffde7de1-13e8-4ea6-98d2-d07a19afee2e {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:30:57.557652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.558460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.561049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.562900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.732370 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:57.741126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f636b040-f7a5-44c0-94bf-761710f4f176 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 200 len: 1327 microversion: 2.1 time: 0.285304 Jun 04 09:30:57.742404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 253/504] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:57 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 1327 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:30:57.772093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:57.773820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:57.786138 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.786809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.787874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.789625 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.835855 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:57.850129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a67e20a2-81ad-44fd-a05b-c40d06922e42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1557 microversion: 2.1 time: 0.322791 Jun 04 09:30:57.851689 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 252/505] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:57 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1557 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:30:57.882834 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:57.886546 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:57.897669 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.904533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:57.904533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:57.904533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:58.114881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:58.121617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4be0a427-399e-437a-a645-957557f6a795 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246999 Jun 04 09:30:58.130895 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 253/506] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:30:57 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:58.140968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:58.156717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:58.156717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9bc9da10-c131-46b1-a5bb-206db68be7f9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.379309 Jun 04 09:30:58.156717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 254/507] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:57 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:30:58.760397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:58.763153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:58.774794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:58.775246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:58.778996 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:58.778996 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:58.794941 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e HTTP/1.1 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:30:58.796758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:30:58.799712 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'ffde7de1-13e8-4ea6-98d2-d07a19afee2e'} Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:30:58.802931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:30:58.806596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:30:58.816627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:30:58.816627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d49c27f9-c649-4c78-aedf-093741820158 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 404 len: 111 microversion: 2.1 time: 0.042647 Jun 04 09:30:58.816627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 254/508] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:30:58 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:30:58.817100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1c066a8e-ac06-488f-90f2-e3e422fa010f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '.version_select at 0x7fa415581ee0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:59.012055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1c066a8e-ac06-488f-90f2-e3e422fa010f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627886981" status: 202 len: 0 microversion: 2.1 time: 0.174431 Jun 04 09:30:59.012055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 255/509] 10.222.0.46 () {58 vars in 1217 bytes} [Sat Jun 4 09:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627886981 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:30:59.174591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:30:59.183246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:30:59.190059 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:59.190846 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:59.191824 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:59.193042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:59.298929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-1dc6199e-bafc-4999-8493-c456801b1119 req-8ada2ef0-8390-4fba-8bb9-46477f69dab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "name": "network-vif-plugged", "status": "completed", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:30:59.327953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-1dc6199e-bafc-4999-8493-c456801b1119 req-8ada2ef0-8390-4fba-8bb9-46477f69dab0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:30:59.328766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-1dc6199e-bafc-4999-8493-c456801b1119 req-8ada2ef0-8390-4fba-8bb9-46477f69dab0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:30:59.353447 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-1dc6199e-bafc-4999-8493-c456801b1119 req-8ada2ef0-8390-4fba-8bb9-46477f69dab0 service nova] Creating event network-vif-plugged:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:30:59.367639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-1dc6199e-bafc-4999-8493-c456801b1119 req-8ada2ef0-8390-4fba-8bb9-46477f69dab0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086600 Jun 04 09:30:59.367639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 256/510] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:30:59.554639 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:59.584690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:59.584690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:30:59.584690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ce26da5f-490f-4fc3-bc79-495e63637e2e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.402989 Jun 04 09:30:59.584960 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 255/511] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:30:59 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:00.217049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-230add6a-0a69-4b2c-9ef4-73f8a1a2fb31 req-c935bb29-1f0c-4c5e-8d75-08a2d4c5f4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd93bd20-00a2-47ab-ba82-3009fdfcf7c7", "tag": "7edf1bae-2245-49a6-877e-aff173928dd1"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:00.240448 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-230add6a-0a69-4b2c-9ef4-73f8a1a2fb31 req-c935bb29-1f0c-4c5e-8d75-08a2d4c5f4b3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:00.244437 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-230add6a-0a69-4b2c-9ef4-73f8a1a2fb31 req-c935bb29-1f0c-4c5e-8d75-08a2d4c5f4b3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:00.278051 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-230add6a-0a69-4b2c-9ef4-73f8a1a2fb31 req-c935bb29-1f0c-4c5e-8d75-08a2d4c5f4b3 service nova] Creating event network-changed:7edf1bae-2245-49a6-877e-aff173928dd1 for instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 on hv-cinder-84469 Jun 04 09:31:00.288099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-230add6a-0a69-4b2c-9ef4-73f8a1a2fb31 req-c935bb29-1f0c-4c5e-8d75-08a2d4c5f4b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086795 Jun 04 09:31:00.294393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 257/512] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:00.612678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:00.615055 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:00.633770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:00.634739 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:00.635896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:00.636726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:00.848968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e5be6ded-e689-4f41-b60d-518303f545f0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: .version_select at 0x7fa415530c10>, body: {"keypair": {"name": "tempest-keypair-1646427805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/qgN9uh75gJYcnDySaB4BmFxPLn84wiHMHNMOqASZ0nWUVrtk5hI/wPFiyz7efE7cGcNMCrj4iWlZSy+qWQWNvVZWi+8CXifOF2Lmo3yxEkW3ci/CTAnLtgFfRH3iAiA=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:00.860221 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:00.885425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-e5be6ded-e689-4f41-b60d-518303f545f0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for project e27e8df485ff405e965cf22847c3b262. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:31:00.899358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-e5be6ded-e689-4f41-b60d-518303f545f0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for user ac869ff528aa49989c88b3a545ba9cf1 and project e27e8df485ff405e965cf22847c3b262. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:31:01.027619 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:01.029821 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e5be6ded-e689-4f41-b60d-518303f545f0 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190094 Jun 04 09:31:01.041376 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 258/513] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:31:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:01.056627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:01.060877 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:01.063557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d7a87fae-ad7c-460e-872e-8e99fc142645 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1406 microversion: 2.20 time: 0.462564 Jun 04 09:31:01.065119 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 256/514] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:00 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:02.093770 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:02.094656 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:02.109413 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:02.110089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:02.110990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:02.112029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:02.481674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:02.497623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:02.502995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:02.506388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cffec108-f7a9-457c-96f4-3cb077aea638 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1598 microversion: 2.20 time: 0.418705 Jun 04 09:31:02.523448 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 259/515] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:02 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1598 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:31:02.547824 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:02.551347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:02.564759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:02.565980 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:02.567742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:02.568946 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:02.721655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a02eec15-deae-42cf-b5b7-a1d9408fccc6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.181985 Jun 04 09:31:02.722274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 257/516] 10.222.0.46 () {60 vars in 1315 bytes} [Sat Jun 4 09:31:02 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 09:31:04.061253 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-45bba6d9-a13d-42ab-8f1d-8ac540d22a51 req-8ac68514-9b72-4dc3-804f-bf233f6aec5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:04.074190 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-45bba6d9-a13d-42ab-8f1d-8ac540d22a51 req-8ac68514-9b72-4dc3-804f-bf233f6aec5b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:04.074968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-45bba6d9-a13d-42ab-8f1d-8ac540d22a51 req-8ac68514-9b72-4dc3-804f-bf233f6aec5b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:04.091876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-45bba6d9-a13d-42ab-8f1d-8ac540d22a51 req-8ac68514-9b72-4dc3-804f-bf233f6aec5b service nova] Creating event network-changed:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:31:04.100821 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-45bba6d9-a13d-42ab-8f1d-8ac540d22a51 req-8ac68514-9b72-4dc3-804f-bf233f6aec5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046858 Jun 04 09:31:04.101785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 260/517] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:04.554844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1875716945", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30b7bf35-2401-45dc-8576-04df5c21df11"}], "security_groups": [{"name": "tempest-securitygroup--166695052"}], "key_name": "tempest-keypair-1646427805", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:04.844198 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] validate_networks() for [('30b7bf35-2401-45dc-8576-04df5c21df11', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:31:05.757920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:31:05.758550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:31:05.759023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:31:05.759692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:31:05.760161 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:31:05.772710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:05.773246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:05.774205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:05.774703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:05.795796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for project e27e8df485ff405e965cf22847c3b262. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:31:05.801108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Getting quotas for user ac869ff528aa49989c88b3a545ba9cf1 and project e27e8df485ff405e965cf22847c3b262. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:31:05.814562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:31:05.817009 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:31:05.993726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43971cba-4ae3-40ee-a07e-18896f107a56 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.443173 Jun 04 09:31:05.994494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 258/518] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:31:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 09:31:06.008379 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c7afb214-341c-426a-990d-aed77d9b815d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:06.009203 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c7afb214-341c-426a-990d-aed77d9b815d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:06.086785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c7afb214-341c-426a-990d-aed77d9b815d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:06.094504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c7afb214-341c-426a-990d-aed77d9b815d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1238 microversion: 2.1 time: 0.091103 Jun 04 09:31:06.095963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 261/519] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:06 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:07.115855 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:07.116605 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:07.124093 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:07.124590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:07.125396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:07.125844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:07.131209 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:07.201938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:07.211606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f7199605-cbc0-458e-8dbe-27cdb534e6d6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1242 microversion: 2.1 time: 0.101115 Jun 04 09:31:07.212447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 259/520] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:07 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:08.232246 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:08.234143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:08.246490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:08.247140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:08.248061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:08.248553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:08.329279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:08.337466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a8d1fe06-6470-4172-8231-5a87b3aaae69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1290 microversion: 2.1 time: 0.111503 Jun 04 09:31:08.338071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 262/521] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:08 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:09.356783 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:09.357808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:09.367873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:09.368431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:09.369260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:09.369710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:09.480958 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:09.491078 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-63cd0811-ef9d-4a2a-9d78-3b026a476d5e tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1308 microversion: 2.1 time: 0.139221 Jun 04 09:31:09.491902 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 260/522] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:09 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1308 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:10.510301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:10.511289 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:10.519964 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:10.520628 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:10.521722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:10.522542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:10.769734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:10.781059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ed7bd20f-7dc3-446e-9088-87800aa8e3a6 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.274765 Jun 04 09:31:10.781945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 263/523] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:10 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:11.139207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-6ae50587-f4f5-45f0-8334-ba85869760a4 req-8f98c23c-6d7e-423b-9202-c46df63e6621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97db5d68-dcb7-483a-b0ed-a1142e4ca67d", "tag": "3c4bc68d-872f-414a-b54e-4885dd81a4e7"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:11.152103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6ae50587-f4f5-45f0-8334-ba85869760a4 req-8f98c23c-6d7e-423b-9202-c46df63e6621 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:11.157679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6ae50587-f4f5-45f0-8334-ba85869760a4 req-8f98c23c-6d7e-423b-9202-c46df63e6621 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:11.167693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-6ae50587-f4f5-45f0-8334-ba85869760a4 req-8f98c23c-6d7e-423b-9202-c46df63e6621 service nova] Creating event network-changed:3c4bc68d-872f-414a-b54e-4885dd81a4e7 for instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d on hv-cinder-84469 Jun 04 09:31:11.178470 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-6ae50587-f4f5-45f0-8334-ba85869760a4 req-8f98c23c-6d7e-423b-9202-c46df63e6621 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043011 Jun 04 09:31:11.179992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 261/524] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:11.804467 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:11.805634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:11.819338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:11.819338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:11.819338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:11.819338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:12.068077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:12.077743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f8024c8a-a85c-45b9-a1ff-25094e95acda tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.277760 Jun 04 09:31:12.078358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 264/525] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:11 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:13.097687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:13.098666 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:13.105683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:13.106134 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:13.106928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:13.107393 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:13.439976 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:13.448453 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fed8f447-4627-4ac7-9e5f-0356f1daa10c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.356328 Jun 04 09:31:13.449066 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 262/526] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:13 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:14.465354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:14.465982 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:14.473614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:14.474063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:14.474851 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:14.475285 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:14.706415 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:14.714238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f9d3510b-b252-46f0-a2cb-798775381824 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.252784 Jun 04 09:31:14.714845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 265/527] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:14 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:15.732788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:15.733443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:15.740841 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:15.741293 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:15.742065 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:15.742499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:15.783768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:15.809112 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:15.887432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:15.895901 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8269f6bf-1759-49dd-b421-c346127fcb04 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.166902 Jun 04 09:31:15.896521 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 263/528] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:15 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:16.912831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:16.913460 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:16.916039 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:16.921295 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:16.921739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:16.923273 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:16.923864 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:17.089509 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:17.091884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:17.103179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04962ac3-2ca1-4868-9895-f89af7d81d1b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.193990 Jun 04 09:31:17.104307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 266/529] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:16 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:18.125470 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:18.126686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:18.133591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:18.134041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:18.135110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:18.135448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:18.276592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:18.284686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-87d8359b-9239-4281-b003-98585a7c3475 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.163137 Jun 04 09:31:18.285263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 264/530] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:18 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:19.189294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a2769cae-4577-476c-8b5f-8ce18d75d1eb req-7640432c-7d3e-4c3e-8371-ebfb12eb4465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97db5d68-dcb7-483a-b0ed-a1142e4ca67d", "name": "network-vif-plugged", "status": "completed", "tag": "3c4bc68d-872f-414a-b54e-4885dd81a4e7"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:19.201066 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a2769cae-4577-476c-8b5f-8ce18d75d1eb req-7640432c-7d3e-4c3e-8371-ebfb12eb4465 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:19.201755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a2769cae-4577-476c-8b5f-8ce18d75d1eb req-7640432c-7d3e-4c3e-8371-ebfb12eb4465 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:19.215377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a2769cae-4577-476c-8b5f-8ce18d75d1eb req-7640432c-7d3e-4c3e-8371-ebfb12eb4465 service nova] Creating event network-vif-plugged:3c4bc68d-872f-414a-b54e-4885dd81a4e7 for instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d on hv-cinder-84469 Jun 04 09:31:19.221197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a2769cae-4577-476c-8b5f-8ce18d75d1eb req-7640432c-7d3e-4c3e-8371-ebfb12eb4465 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 Jun 04 09:31:19.221824 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 267/531] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:19.305182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:19.308792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:19.324249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:19.325509 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:19.327336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:19.328517 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:19.502064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:19.509994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3c717923-2741-485f-b7c2-d8ea5899152b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.211861 Jun 04 09:31:19.510575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 265/532] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:19 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:19.992047 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:19.992654 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:19.999371 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:19.999812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.000609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:20.001036 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.092186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'services' on Instance uuid d387fd90-a667-4aa4-a900-db1a4708a0fc {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:31:20.400359 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-154116cd-74e6-41ca-9c09-c810d16b2e30 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments/95297221-26e9-4393-b563-ef9f7f28babe" status: 202 len: 0 microversion: 2.1 time: 0.412679 Jun 04 09:31:20.401623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 268/533] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:31:19 2022] DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments/95297221-26e9-4393-b563-ef9f7f28babe => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:31:20.411482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:20.412498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:20.415053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:20.420740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:20.421193 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.422000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:20.422481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.457351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6ffe7c8e-9eb6-4d5a-85d8-8a7f0590f858 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050839 Jun 04 09:31:20.461194 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 266/534] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:20 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:20.535160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:20.535160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:20.537860 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:20.538311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.539151 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:20.539630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:20.705455 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:20.724045 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a78acc0d-5019-4f79-94c5-aea1923b8b2a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1363 microversion: 2.1 time: 0.199295 Jun 04 09:31:20.725147 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 269/535] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:20 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:21.471890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:21.472959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:21.480796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.481249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:21.482035 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.482468 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:21.517634 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-61356981-7064-4bff-9d90-19d02a48117d tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Jun 04 09:31:21.518234 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 267/536] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:21 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:21.748320 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:21.748994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:21.756455 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.756903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:21.757692 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.758125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:21.910652 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:21.918985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aa59193c-62d5-4899-b4d6-2729153b90b8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1550 microversion: 2.1 time: 0.174695 Jun 04 09:31:21.919605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 270/537] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:21 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:21.942654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:21.943154 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:21.949915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.956932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:21.956932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:21.956932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:22.045678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fb6fb063-db5c-4de9-b6aa-f1c48d7331c9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107337 Jun 04 09:31:22.046818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 268/538] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:31:21 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:22.529815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:22.531026 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:22.537850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:22.538293 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:22.539100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:22.539549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:22.579953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db4c5aa5-18be-4683-a2cd-3482273ddacb tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054114 Jun 04 09:31:22.584830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 271/539] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:22 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:23.417177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-e0d5f644-7b8e-4f2f-81de-4a2788daafb5 req-21bb2f25-0dc8-4978-a407-8690d14e9df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97db5d68-dcb7-483a-b0ed-a1142e4ca67d", "tag": "3c4bc68d-872f-414a-b54e-4885dd81a4e7"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:23.426812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-e0d5f644-7b8e-4f2f-81de-4a2788daafb5 req-21bb2f25-0dc8-4978-a407-8690d14e9df6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:23.427250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-e0d5f644-7b8e-4f2f-81de-4a2788daafb5 req-21bb2f25-0dc8-4978-a407-8690d14e9df6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:23.440776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-e0d5f644-7b8e-4f2f-81de-4a2788daafb5 req-21bb2f25-0dc8-4978-a407-8690d14e9df6 service nova] Creating event network-changed:3c4bc68d-872f-414a-b54e-4885dd81a4e7 for instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d on hv-cinder-84469 Jun 04 09:31:23.447006 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-e0d5f644-7b8e-4f2f-81de-4a2788daafb5 req-21bb2f25-0dc8-4978-a407-8690d14e9df6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033739 Jun 04 09:31:23.447923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 269/540] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:23.592831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:23.594904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:23.602982 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:23.603598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:23.604559 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:23.605297 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:23.641657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-70e714eb-397d-453c-9949-1195e1d617fa tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053381 Jun 04 09:31:23.651422 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 272/541] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:23 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:31:23.771351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:23.772540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:23.781089 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:23.782541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:23.783597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:23.785242 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:23.826445 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:31:24.217566 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-87ee227d-cec1-4830-9987-9470d41e8935 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 204 len: 0 microversion: 2.1 time: 0.450989 Jun 04 09:31:24.218602 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 270/542] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:31:23 2022] DELETE /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:31:24.228737 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:24.229354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:24.237012 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:24.237614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:24.238869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:24.240115 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:24.427954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:24.448732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e46b266b-8b45-461f-8099-e590fd4173ab tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1690 microversion: 2.1 time: 0.224000 Jun 04 09:31:24.450103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 273/543] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:24 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:25.470175 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:25.470877 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:25.478336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:25.478844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:25.479672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:25.480162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:25.660579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:25.674518 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4847599b-384b-42f0-97e5-91c3a3047117 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1690 microversion: 2.1 time: 0.208545 Jun 04 09:31:25.675557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 271/544] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:25 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:26.701713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:26.702633 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:26.710756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:26.711308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:26.712347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:26.712849 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:26.862901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:26.870609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a2a07360-d1cd-439f-99b1-193a6218cbcf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1690 microversion: 2.1 time: 0.173413 Jun 04 09:31:26.871183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 274/545] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:26 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:27.887911 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:27.888756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:27.896253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:27.896746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:27.897553 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:27.898002 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:28.088658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:28.097282 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07e59bdf-6e66-4a10-9ea3-d1b8f48e9bea tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1690 microversion: 2.1 time: 0.213193 Jun 04 09:31:28.097880 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 272/546] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:27 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:29.116132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:29.117048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:29.126469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:29.127081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:29.128109 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:29.128705 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:29.244964 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:29.252995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-6ea881f8-b221-41ab-8cbc-4f93d29b5aa6 req-ff43a9bc-1f81-4ed4-abb0-7ae659ab41cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d387fd90-a667-4aa4-a900-db1a4708a0fc", "name": "network-vif-deleted", "tag": "2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:29.267583 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7e3b8a37-7715-4136-8cc5-46b03732b1f4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1623 microversion: 2.1 time: 0.152471 Jun 04 09:31:29.268361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 275/547] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:29 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1623 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:29.270757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6ea881f8-b221-41ab-8cbc-4f93d29b5aa6 req-ff43a9bc-1f81-4ed4-abb0-7ae659ab41cb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:29.271505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6ea881f8-b221-41ab-8cbc-4f93d29b5aa6 req-ff43a9bc-1f81-4ed4-abb0-7ae659ab41cb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:29.288014 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-6ea881f8-b221-41ab-8cbc-4f93d29b5aa6 req-ff43a9bc-1f81-4ed4-abb0-7ae659ab41cb service nova] Creating event network-vif-deleted:2cf3c28b-42e1-4e5a-bea3-45ab6e8db67a for instance d387fd90-a667-4aa4-a900-db1a4708a0fc on hv-cinder-84469 Jun 04 09:31:29.298963 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-6ea881f8-b221-41ab-8cbc-4f93d29b5aa6 req-ff43a9bc-1f81-4ed4-abb0-7ae659ab41cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052017 Jun 04 09:31:29.300323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 273/548] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:30.374209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:30.374209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:30.383441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:30.384192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:30.385365 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:30.385902 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:30.441554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:30.442164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:30.442702 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'fault' on Instance uuid d387fd90-a667-4aa4-a900-db1a4708a0fc {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:31:30.490228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:30.499177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2570beb3-1710-4bb8-99a5-2629953b673e tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 200 len: 1335 microversion: 2.1 time: 0.210956 Jun 04 09:31:30.501222 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 276/549] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:30 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 1335 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:31.518532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:31.519241 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d387fd90-a667-4aa4-a900-db1a4708a0fc] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:31.527902 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:31.528228 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:31.529057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:31.529494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:31.545630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] HTTP exception thrown: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Request method failure captured: Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc HTTP/1.1 Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVHcosoWg4BkQ3m39Jw8redzlOM5ZqGfaRM5DyEYeFsJFrwbLK94TPaWAP4jk1gXl_fXNWbXw7HbRrztESHYfXZfSdysapX2P3MsRkFWlYGzC_0Scq47em5ewBvkKym0v4zc_7k710Vza6mw7MzipJj2JZWhvYc0Q2c7HKkVFD6NSI Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:31:31.547482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e42983d2d3964b8cb5d32e6d653d6dfd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 34a7ef6d33b141ce8fb1cec517faffd1 Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. Jun 04 09:31:31.550122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'd387fd90-a667-4aa4-a900-db1a4708a0fc'} Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:31:31.551736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. Jun 04 09:31:31.554436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:31.556654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Returning 404 to user: Instance d387fd90-a667-4aa4-a900-db1a4708a0fc could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:31:31.556654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-550f65e4-31fe-4e91-90af-319b0bfedf43 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc" status: 404 len: 111 microversion: 2.1 time: 0.035872 Jun 04 09:31:31.556654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 274/550] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:31 2022] GET /compute/v2.1/servers/d387fd90-a667-4aa4-a900-db1a4708a0fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:31:31.563774 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-727822d9-6abd-412a-9cf6-85d912c2cfc7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '.version_select at 0x7fa415530ee0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:31.680728 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-727822d9-6abd-412a-9cf6-85d912c2cfc7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169491684" status: 202 len: 0 microversion: 2.1 time: 0.124310 Jun 04 09:31:31.681326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 277/551] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jun 4 09:31:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1169491684 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:31:35.221927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:35.222550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:35.229940 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:35.230390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:35.231172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:35.231606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:35.259231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:31:35.394586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:35.617693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-07e058ca-1b52-469a-b1cb-43b656d1b673 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 204 len: 0 microversion: 2.1 time: 0.399658 Jun 04 09:31:35.618328 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 275/552] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:31:35 2022] DELETE /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:31:35.628189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:35.632456 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:35.632456 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:35.636254 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:35.636771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:35.637584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:35.638029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:35.805798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:35.814641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3f4da3e0-92c3-4ed6-bbff-a6ff1c12d493 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1508 microversion: 2.1 time: 0.191581 Jun 04 09:31:35.815245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 278/553] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:35 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:36.838828 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:36.840142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:36.853758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:36.854221 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:36.855531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:36.856324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:37.082784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:37.092247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dd8a65d3-e87e-487e-91b4-1881304a763f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1508 microversion: 2.1 time: 0.261054 Jun 04 09:31:37.092925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 276/554] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:36 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:38.110867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:38.111653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:38.118061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:38.118513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:38.119306 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:38.119745 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:38.157124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:38.157931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:38.164908 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:38.165362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:38.166156 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:38.166593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:38.194300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-029495ee-cf6d-4911-add1-0f9a09dc4475 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.043582 Jun 04 09:31:38.201471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 277/555] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:31:38 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:38.276863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:38.288941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-925674b1-4e38-4bf2-aa3e-f0ccb3b7bc8f tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1508 microversion: 2.1 time: 0.181918 Jun 04 09:31:38.290019 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 279/556] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:38 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:39.126654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-1ddcd0eb-d683-40a0-8341-3ba1c0fe94e5 req-db9e10a5-279b-4f3f-8ede-6190ae357ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92f8d5f8-9053-432b-918a-3c3b59143d88", "name": "network-vif-deleted", "tag": "98695bf0-7d62-4518-9f4c-0adc21e6836d"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:39.135901 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1ddcd0eb-d683-40a0-8341-3ba1c0fe94e5 req-db9e10a5-279b-4f3f-8ede-6190ae357ad9 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:39.136390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1ddcd0eb-d683-40a0-8341-3ba1c0fe94e5 req-db9e10a5-279b-4f3f-8ede-6190ae357ad9 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:39.163853 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-1ddcd0eb-d683-40a0-8341-3ba1c0fe94e5 req-db9e10a5-279b-4f3f-8ede-6190ae357ad9 service nova] Creating event network-vif-deleted:98695bf0-7d62-4518-9f4c-0adc21e6836d for instance 92f8d5f8-9053-432b-918a-3c3b59143d88 on hv-cinder-84469 Jun 04 09:31:39.175874 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-1ddcd0eb-d683-40a0-8341-3ba1c0fe94e5 req-db9e10a5-279b-4f3f-8ede-6190ae357ad9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052208 Jun 04 09:31:39.177075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 278/557] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:31:39.317068 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:39.318238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:39.329368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:39.329917 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:39.331139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:39.331683 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:39.408841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:39.419724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-48cc2b16-e62d-4930-bf80-7334cefdb9f7 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 200 len: 1466 microversion: 2.1 time: 0.110954 Jun 04 09:31:39.420398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 280/558] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:39 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 1466 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:40.093905 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65aa17b8-3596-4099-be23-b5b9bd4f1086"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:40.095086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:40.102347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.102933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.103715 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.104160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.445033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:40.446126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: 92f8d5f8-9053-432b-918a-3c3b59143d88] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:40.458394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.464072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.464072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.464072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.488799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] HTTP exception thrown: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Request method failure captured: Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 HTTP/1.1 Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVHcosoWg4BkQ3m39Jw8redzlOM5ZqGfaRM5DyEYeFsJFrwbLK94TPaWAP4jk1gXl_fXNWbXw7HbRrztESHYfXZfSdysapX2P3MsRkFWlYGzC_0Scq47em5ewBvkKym0v4zc_7k710Vza6mw7MzipJj2JZWhvYc0Q2c7HKkVFD6NSI Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:31:40.491992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e42983d2d3964b8cb5d32e6d653d6dfd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 34a7ef6d33b141ce8fb1cec517faffd1 Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. Jun 04 09:31:40.501310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '92f8d5f8-9053-432b-918a-3c3b59143d88'} Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:31:40.502858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. Jun 04 09:31:40.505599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:40.508449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Returning 404 to user: Instance 92f8d5f8-9053-432b-918a-3c3b59143d88 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:31:40.508449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-69c24241-ea88-4034-9d3f-bdb4d27cef17 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88" status: 404 len: 111 microversion: 2.1 time: 0.056778 Jun 04 09:31:40.508449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 281/559] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:40 2022] GET /compute/v2.1/servers/92f8d5f8-9053-432b-918a-3c3b59143d88 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:31:40.508449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:40.508981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:40.517704 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.518558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.518922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.519436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.549307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:31:40.877144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a0cc469c-cd3c-46af-a19d-dcd3de57e3d4 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 204 len: 0 microversion: 2.1 time: 0.375297 Jun 04 09:31:40.878059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 282/560] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:31:40 2022] DELETE /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:31:40.886575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:40.892406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:40.894219 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.894661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.895443 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:40.895878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:40.899186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:41.041899 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:41.049891 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d48ffc09-035b-4349-95ce-59be92021fc8 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.167604 Jun 04 09:31:41.052518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 283/561] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:40 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:41.381807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fd9c5ae6-31c8-4807-a7fa-f5797e1a0020 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.292494 Jun 04 09:31:41.382671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 279/562] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:31:40 2022] POST /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments => generated 194 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:42.071724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:42.072796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:42.085835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:42.086645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:42.088212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:42.089024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:42.179579 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:42.180165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:42.188714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:42.189173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:42.189983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:42.191113 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:42.217646 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-51dba294-1e13-41d0-a90d-f2fac623b3a5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/ips" status: 200 len: 152 microversion: 2.20 time: 0.128282 Jun 04 09:31:42.219470 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 280/563] 10.222.0.46 () {60 vars in 1288 bytes} [Sat Jun 4 09:31:42 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/ips => generated 152 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:31:42.299886 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:42.309893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7e64bb44-a621-4b17-aadb-2c03163fd196 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.245407 Jun 04 09:31:42.310999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 284/564] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:42 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:43.338479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:43.339329 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:43.348618 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:43.349158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:43.350226 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:43.350673 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:43.492100 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:43.500247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-11261733-6990-41f7-ab72-d9877dbc9fdf tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.167143 Jun 04 09:31:43.500846 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 281/565] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:43 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:44.520650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:44.522985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:44.538072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:44.539295 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:44.541128 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:44.541998 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:45.070240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:45.081260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-14ae4660-0707-41e1-8829-a28d8e0fe621 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1522 microversion: 2.1 time: 0.566333 Jun 04 09:31:45.082033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 285/566] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:44 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:45.330975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:45.331780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:45.342324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:45.343034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:45.344373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:45.345052 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:45.384642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lazy-loading 'flavor' on Instance uuid 520e177e-a9b1-47c1-b519-1c53bf52bc2a {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:31:45.544612 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-7b3fdfd2-e8ab-4296-90bf-f85f2b5ed459 req-496db43a-c2f7-42ab-8130-45b70bdcc67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4", "name": "network-vif-deleted", "tag": "c2a78627-a21d-4c75-b1ec-12a456b91ec2"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:45.553621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7b3fdfd2-e8ab-4296-90bf-f85f2b5ed459 req-496db43a-c2f7-42ab-8130-45b70bdcc67d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:45.554064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-7b3fdfd2-e8ab-4296-90bf-f85f2b5ed459 req-496db43a-c2f7-42ab-8130-45b70bdcc67d service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:45.567186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-7b3fdfd2-e8ab-4296-90bf-f85f2b5ed459 req-496db43a-c2f7-42ab-8130-45b70bdcc67d service nova] Creating event network-vif-deleted:c2a78627-a21d-4c75-b1ec-12a456b91ec2 for instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 on hv-cinder-84469 Jun 04 09:31:45.572636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-7b3fdfd2-e8ab-4296-90bf-f85f2b5ed459 req-496db43a-c2f7-42ab-8130-45b70bdcc67d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094616 Jun 04 09:31:45.573255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 286/567] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:46.093162 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9bd71ede-97fc-415a-996d-23c6a23f975b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/action" status: 202 len: 0 microversion: 2.20 time: 0.770098 Jun 04 09:31:46.094020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 282/568] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jun 4 09:31:45 2022] POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:31:46.103542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:46.104469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:46.110497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:46.111508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:46.113085 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:46.113653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:46.114521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:46.115023 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:46.120063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:46.120830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:46.121780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:46.122330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:46.160692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:46.161148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:46.161621 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lazy-loading 'fault' on Instance uuid d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:31:46.282056 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a7ef6d33b141ce8fb1cec517faffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42983d2d3964b8cb5d32e6d653d6dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:46.290446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-aeb816b1-ca2b-4776-8d4a-0d5484f380a3 tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 200 len: 1312 microversion: 2.1 time: 0.186857 Jun 04 09:31:46.291337 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 283/569] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:46 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:31:46.382287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:46.391943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:46.393587 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:46.394804 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f509d646-de0e-451e-a5ce-f22135d5bf2c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.296050 Jun 04 09:31:46.395421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 287/570] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:46 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:47.307970 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:47.308807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] [instance: d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:47.316207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:47.316714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:47.317517 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:47.317955 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:47.341633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] HTTP exception thrown: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Request method failure captured: Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 HTTP/1.1 Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVHcosoWg4BkQ3m39Jw8redzlOM5ZqGfaRM5DyEYeFsJFrwbLK94TPaWAP4jk1gXl_fXNWbXw7HbRrztESHYfXZfSdysapX2P3MsRkFWlYGzC_0Scq47em5ewBvkKym0v4zc_7k710Vza6mw7MzipJj2JZWhvYc0Q2c7HKkVFD6NSI Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:31:47.345288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e42983d2d3964b8cb5d32e6d653d6dfd", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e42983d2d3964b8cb5d32e6d653d6dfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e42983d2d3964b8cb5d32e6d653d6dfd Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1700738427 Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 34a7ef6d33b141ce8fb1cec517faffd1 Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1700738427-project Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. Jun 04 09:31:47.347591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'd1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4'} Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:31:47.348922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. Jun 04 09:31:47.351889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:31:47.354112 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] Returning 404 to user: Instance d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:31:47.354112 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-431610b8-09ac-40e6-a30a-25a06ad9f0ad tempest-ServerRescueNegativeTestJSON-1700738427 tempest-ServerRescueNegativeTestJSON-1700738427-project] 10.222.0.46 "GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4" status: 404 len: 111 microversion: 2.1 time: 0.043689 Jun 04 09:31:47.354112 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 284/571] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:47 2022] GET /compute/v2.1/servers/d1fa1ce9-0c58-43f8-b04f-44bc5b5ae9d4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:31:47.416830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:47.417803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:47.428506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:47.429028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:47.429984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:47.430641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:47.635240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:47.647638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:47.649705 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:47.651022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c93b9f41-c3bd-4402-b85d-f016ce01d512 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.240955 Jun 04 09:31:47.651733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 288/572] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:47 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:48.671760 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:48.672666 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:48.679693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:48.680140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:48.680971 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:48.681404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:48.870882 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:48.883269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:48.885939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:48.887599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-262e73df-591d-4907-bdef-8688d407a052 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.220450 Jun 04 09:31:48.890353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 285/573] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:48 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:31:49.915137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:49.916336 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:49.928760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:49.929586 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:49.931905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:49.932616 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:50.144694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:50.154945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:50.156791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:50.158262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-32d9f388-e0af-43e0-9931-75fe22940d25 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.251300 Jun 04 09:31:50.163982 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 289/574] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:49 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:51.184576 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:51.185801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:51.199277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:51.200141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:51.203124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:51.203975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:51.542544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:51.559091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:51.559091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:51.560988 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-46922a74-0659-4848-a01e-97516430ae1e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.385957 Jun 04 09:31:51.561688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 286/575] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:51 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:52.337989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65aa17b8-3596-4099-be23-b5b9bd4f1086"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:52.340126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:52.352994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.353791 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.355212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.356230 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.527604 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: POST /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments HTTP/1.1 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 74 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:31:52.529401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {"volumeAttachment": {"volumeId": "65aa17b8-3596-4099-be23-b5b9bd4f1086"}} Jun 04 09:31:52.531541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'server_id': 'dd93bd20-00a2-47ab-ba82-3009fdfcf7c7', 'body': {'volumeAttachment': {'volumeId': '65aa17b8-3596-4099-be23-b5b9bd4f1086'}}} Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:52.532794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:31:52.534713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 400 to user: Invalid volume: volume 65aa17b8-3596-4099-be23-b5b9bd4f1086 is already attached to instances: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a01d6bd7-45c8-444b-9506-70336f29f08c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.201694 Jun 04 09:31:52.538077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 290/576] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:31:52 2022] POST /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments => generated 174 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:31:52.589421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:52.590177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:52.610392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:52.610392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.610392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.610392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.611260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.643609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:52.644508 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:52.656044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.656872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.658521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:52.659341 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:52.804230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:52.818463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:52.821598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:52.822653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'services' on Instance uuid dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:31:52.823637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-702d1041-ebf5-4d55-ba06-decb0631839b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.238542 Jun 04 09:31:52.825023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 287/577] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:52 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:53.126203 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3d6a7d60-a5a9-4aec-8d71-46a4e3dbc6d4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments/65aa17b8-3596-4099-be23-b5b9bd4f1086" status: 202 len: 0 microversion: 2.1 time: 0.489784 Jun 04 09:31:53.127230 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 291/578] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:31:52 2022] DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments/65aa17b8-3596-4099-be23-b5b9bd4f1086 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:31:53.141673 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:53.143554 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:53.155747 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:53.156330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:53.157575 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:53.158022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:53.194527 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6bace6b7-f1ea-4471-ac39-9b70c2df297a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061159 Jun 04 09:31:53.195143 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 288/579] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:53 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:53.850323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:53.851487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:53.863764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:53.864604 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:53.865943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:53.866672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:54.051920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:54.063188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:54.066152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:54.068506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-91c9078d-43f2-4e21-9006-1c4f3b57a874 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.225892 Jun 04 09:31:54.069567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 292/580] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:53 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:54.211931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:54.213594 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:54.235498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:54.236068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:54.236928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:54.237418 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:54.277125 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-31cc55b6-bde3-4956-bcce-2c06d23233dc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072846 Jun 04 09:31:54.278096 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 289/581] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:54 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:55.094639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:55.095484 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:55.103420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.103848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.104670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.105111 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.296731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:55.298446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:55.299885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:55.313008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:55.314047 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.314850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:55.315309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.316557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d5265c5c-29d6-4550-aca6-58ef766835b7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.226489 Jun 04 09:31:55.317404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 293/582] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:55 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:55.317664 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.319323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.353106 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:55.378600 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-043a4069-adda-4efe-8da7-534988d158e3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089091 Jun 04 09:31:55.379679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 290/583] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:31:55 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:31:55.453726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:55.454232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:55.460905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.461379 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.462175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.462625 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.491117 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:31:55.814350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1b1765a9-d6f2-4f31-be87-076ad5827574 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 204 len: 0 microversion: 2.1 time: 0.364103 Jun 04 09:31:55.815334 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 294/584] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:31:55 2022] DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:31:55.826401 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:55.827308 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:55.837598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.851266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:55.851266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:55.851266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:56.098439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:56.110888 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d2aa6be4-918c-49bc-b890-eab2042d7644 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1681 microversion: 2.1 time: 0.289656 Jun 04 09:31:56.111803 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 291/585] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:55 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1681 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:56.366194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:56.366936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:56.374936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:56.375518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:56.376241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:56.376705 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:56.557384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:56.567531 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:56.569766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:56.571223 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f05991a4-78bd-4eab-b47d-c2f3e8ff9c81 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.209399 Jun 04 09:31:56.571909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 295/586] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:56 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:57.133251 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:57.134124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:57.141509 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:57.142215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:57.142973 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:57.143711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:57.314686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:57.322934 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-20db228b-17a4-483f-a0b9-0e2b3b33586c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1681 microversion: 2.1 time: 0.195016 Jun 04 09:31:57.331204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 292/587] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:57 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:57.593611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:57.594264 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:57.602966 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:57.603707 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:57.605078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:57.605852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:58.031154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:58.039927 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:58.041541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:58.042762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-18d4d1da-d869-4ab4-9678-2b77f90c16c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.456776 Jun 04 09:31:58.043360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 296/588] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:57 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:31:58.345995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:58.347147 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:58.359780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:58.360615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:58.362184 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:58.362916 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:58.738270 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:58.755399 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4ee651dc-b7f2-406f-af8c-3d5d9b2bdec4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1681 microversion: 2.1 time: 0.416291 Jun 04 09:31:58.756989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 293/589] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:58 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1681 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:31:59.061606 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:59.062359 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:59.069530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:59.070247 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:59.071244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:59.071853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:59.424209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:59.455427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:59.460995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:59.465852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ed45579-f13e-4071-8823-8af301b99d08 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.406732 Jun 04 09:31:59.472439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 297/590] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:31:59 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:31:59.532373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ad0f54f6-6032-4f0d-b20e-93381b170edf req-e314b164-efd7-4080-947f-34302695dbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd93bd20-00a2-47ab-ba82-3009fdfcf7c7", "name": "network-vif-deleted", "tag": "7edf1bae-2245-49a6-877e-aff173928dd1"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:31:59.552355 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ad0f54f6-6032-4f0d-b20e-93381b170edf req-e314b164-efd7-4080-947f-34302695dbf5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:59.553041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ad0f54f6-6032-4f0d-b20e-93381b170edf req-e314b164-efd7-4080-947f-34302695dbf5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:59.581916 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ad0f54f6-6032-4f0d-b20e-93381b170edf req-e314b164-efd7-4080-947f-34302695dbf5 service nova] Creating event network-vif-deleted:7edf1bae-2245-49a6-877e-aff173928dd1 for instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 on hv-cinder-84469 Jun 04 09:31:59.591116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ad0f54f6-6032-4f0d-b20e-93381b170edf req-e314b164-efd7-4080-947f-34302695dbf5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065597 Jun 04 09:31:59.593124 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 294/591] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:31:59.785157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:31:59.785838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:31:59.795556 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:59.799835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:59.800780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:31:59.801253 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:31:59.865062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:31:59.915688 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:31:59.929608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fd859b18-e261-420f-a16d-a096d85ad533 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1326 microversion: 2.1 time: 0.148928 Jun 04 09:31:59.937672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 298/592] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:31:59 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:00.364131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:00.365260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:00.378432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.379203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:00.380832 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.393861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:00.447477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2549479d-fe0e-4d1d-85ec-579d3dbd6c9a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/ips" status: 200 len: 147 microversion: 2.1 time: 0.434133 Jun 04 09:32:00.450233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 295/593] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:32:00 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/ips => generated 147 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:00.499931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:00.499931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:00.515068 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.516352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:00.519589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.522191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:00.748101 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:00.757665 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:00.759680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:00.761149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-beaef8d6-e31d-4b6e-bb0a-07274531d527 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.278620 Jun 04 09:32:00.761829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 299/594] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:00 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:00.953004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:00.954120 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:00.967762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.968592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:00.969964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:00.970769 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:01.034332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:01.035622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:01.036693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'fault' on Instance uuid dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:32:01.117986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:01.132487 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e6802008-8406-4c07-81b4-b76bdfeeb3fe tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 200 len: 1331 microversion: 2.1 time: 0.185502 Jun 04 09:32:01.133837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 296/595] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:00 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 1331 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:01.786299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:01.787009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:01.795801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:01.796337 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:01.797438 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:01.798010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:01.972981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:01.984140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:01.986231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:01.987743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6a10fa28-e730-4220-8733-496c9558af15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.205861 Jun 04 09:32:01.988459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 300/596] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:01 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:02.168999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:02.173174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:02.177038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:02.177493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:02.178337 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:02.178778 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:02.193608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 HTTP/1.1 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:32:02.199122 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:32:02.202535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'dd93bd20-00a2-47ab-ba82-3009fdfcf7c7'} Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:02.204458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:32:02.207129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:02.209428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:02.209428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3e0fc467-e4d2-4abd-8664-d8e0407f973e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 404 len: 111 microversion: 2.1 time: 0.032524 Jun 04 09:32:02.209428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 297/597] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:02 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:02.211525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-43fc5d97-0a7a-4f39-bcc9-9051b7ea5660 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '.version_select at 0x7fa41544b3a0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:02.359469 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-43fc5d97-0a7a-4f39-bcc9-9051b7ea5660 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423717385" status: 202 len: 0 microversion: 2.1 time: 0.155107 Jun 04 09:32:02.360036 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 301/598] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jun 4 09:32:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423717385 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:32:02.501901 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95b09a27-8041-4374-8dfe-b8abf9f86015"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:02.504403 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:02.514769 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:02.515588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:02.516953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:02.517668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:03.013674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:03.014410 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:03.022059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:03.022788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:03.023741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:03.024220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:03.240736 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:03.257811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:03.260973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:03.263009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5feebf9b-6ccd-46f8-8b01-8e71bf535a7e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.253920 Jun 04 09:32:03.264409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 302/599] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:03 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:03.300718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aecc9929-9891-457a-b7b2-f3a79ddb15b9 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: .version_select at 0x7fa4156d0dc0>, body: {"keypair": {"name": "tempest-keypair-1353995034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDegCKjF+tmGHe2VtIXYhSBAhJ0p+uqXfePQRW1cCAYv/dqjkCnNFbVxVSH/6ikWkQ92Zo22tBy0Gzi2RP+Iv0gaJI3oWMX69v1NhzxoFMS/P/Bed2h84m/aO4qesx/T6A=="}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:03.316144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-aecc9929-9891-457a-b7b2-f3a79ddb15b9 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:32:03.323539 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-aecc9929-9891-457a-b7b2-f3a79ddb15b9 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'key_pairs'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:32:03.431921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aecc9929-9891-457a-b7b2-f3a79ddb15b9 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135704 Jun 04 09:32:03.432746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 303/600] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:32:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:04.284022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:04.285198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:04.297335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:04.298007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:04.299124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:04.299697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:04.500031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:04.511581 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:04.514284 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:04.515573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cfde8c8c-aec0-41eb-98c6-f99b18fb4ede tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.237020 Jun 04 09:32:04.516172 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 304/601] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:04 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:05.547748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:05.548961 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:05.560646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:05.561360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:05.562727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:05.563733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:05.851461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:05.863037 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:05.865337 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:05.866866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f753e075-ea97-433c-a5d9-dd4e9a96f2bb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1744 microversion: 2.20 time: 0.327020 Jun 04 09:32:05.867696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 305/602] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:05 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:06.081133 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b7918f05-4d5e-4f0d-bd67-6a90d79ea38b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.587913 Jun 04 09:32:06.089155 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 298/603] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:32:02 2022] POST /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 194 bytes in 3591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:06.892125 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:06.893174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:06.897208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:06.906150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:06.906981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:06.908513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:06.909344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:07.178126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:07.187432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:07.189621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:07.191141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-30c881d3-b484-44bd-b0b6-26574b01f558 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1744 microversion: 2.20 time: 0.306520 Jun 04 09:32:07.191787 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 306/604] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:06 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1744 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:07.478220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1197782231", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72d5f400-ff54-4f35-902d-3289af4496b7"}], "security_groups": [{"name": "tempest-securitygroup--1013092114"}], "key_name": "tempest-keypair-1353995034", "user_data": "}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:07.667995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] validate_networks() for [('72d5f400-ff54-4f35-902d-3289af4496b7', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:32:08.212930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:08.213893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:08.224882 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:08.226925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:08.228376 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:08.229163 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:08.464864 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:32:08.466850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:32:08.468441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:32:08.470025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:32:08.471041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:32:08.489697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:08.491170 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:08.492717 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:08.493916 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:08.511254 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:08.527685 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:08.531105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:08.532659 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b0de31b3-cbc9-4e5f-a211-ad8a1bbfd457 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.325278 Jun 04 09:32:08.533802 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 307/605] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:08 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:08.535286 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:32:08.555889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Getting quotas for user aeffa44fe38a4204ae21b52fe827cedc and project 7410684ee8db448d8385de8549bce1a7. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:32:08.588755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:32:08.588755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:32:08.728562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-297ed4e7-5f2e-443e-910c-dbe0141da16a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.260199 Jun 04 09:32:08.729752 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 299/606] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:32:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:32:08.743341 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-412a4618-937e-4d49-8666-3e34f90d7023 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:08.744144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-412a4618-937e-4d49-8666-3e34f90d7023 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:08.825719 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-412a4618-937e-4d49-8666-3e34f90d7023 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:08.836873 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-412a4618-937e-4d49-8666-3e34f90d7023 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1242 microversion: 2.1 time: 0.099399 Jun 04 09:32:08.838241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 308/607] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:08 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:09.569953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:09.571010 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:09.597995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:09.603655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:09.603655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:09.603655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:09.814404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-570af278-c669-4e4c-afdc-e80bab427896 req-5b7abab9-48de-4d9b-a59f-ea3af16a1673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "name": "network-vif-plugged", "status": "completed", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:09.862418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-570af278-c669-4e4c-afdc-e80bab427896 req-5b7abab9-48de-4d9b-a59f-ea3af16a1673 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:09.863989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-570af278-c669-4e4c-afdc-e80bab427896 req-5b7abab9-48de-4d9b-a59f-ea3af16a1673 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:09.901742 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-570af278-c669-4e4c-afdc-e80bab427896 req-5b7abab9-48de-4d9b-a59f-ea3af16a1673 service nova] Creating event network-vif-plugged:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:32:09.923224 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-570af278-c669-4e4c-afdc-e80bab427896 req-5b7abab9-48de-4d9b-a59f-ea3af16a1673 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354500 Jun 04 09:32:09.941504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 309/608] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:09.949883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cccd8d2b-fcad-4071-aac8-1e8afb21c2f7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:09.951566 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cccd8d2b-fcad-4071-aac8-1e8afb21c2f7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:10.004089 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:10.021333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:10.023768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:10.030199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75cff3a1-e353-48ba-8fd2-240058e00ce1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.465712 Jun 04 09:32:10.043211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 300/609] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:09 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:10.096350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cccd8d2b-fcad-4071-aac8-1e8afb21c2f7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:10.110607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cccd8d2b-fcad-4071-aac8-1e8afb21c2f7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1242 microversion: 2.1 time: 0.166854 Jun 04 09:32:10.122373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 310/610] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:09 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:11.059915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:11.060855 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:11.069590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:11.070196 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:11.071151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:11.071669 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:11.130441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:11.131299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:11.143126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:11.145557 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:11.146639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:11.147263 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:11.297364 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:11.319974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c1db0ff3-2132-4bbb-9517-4e74767a9487 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1294 microversion: 2.1 time: 0.189920 Jun 04 09:32:11.319974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 311/611] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:11 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1294 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:11.411198 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:11.422284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:11.424180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:11.425680 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7162ce44-cf1d-4c76-8eaf-2225344fd0c8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.377800 Jun 04 09:32:11.426280 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 301/612] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:11 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:12.342072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:12.342905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:12.356200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:12.357478 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:12.358282 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:12.358717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:12.448227 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:12.449438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:12.468687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:12.469565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:12.471034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:12.471761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:12.505756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:12.518150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fe004fe1-cb0a-4921-8bbd-ab8e8a9a5569 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1300 microversion: 2.1 time: 0.180493 Jun 04 09:32:12.522165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 312/613] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:12 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:32:12.778283 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:12.791490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:12.795068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:12.797812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b75e0bee-65e6-40a9-9ad3-4d85ad2b024c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.357322 Jun 04 09:32:12.799339 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 302/614] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:12 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:13.588011 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:13.591721 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:13.638111 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:13.642346 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:13.645526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:13.649979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:13.858332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:13.864974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:13.903535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:13.912930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:13.935859 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:13.937491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:13.984027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:13.998191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-76366601-294b-4d99-a350-b9a9e2cf676b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.443270 Jun 04 09:32:14.003335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 313/615] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:13 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:32:14.391395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:14.400151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:14.401756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:14.402991 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0f71623a-7945-4292-8bcf-f6da315df0f4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.587316 Jun 04 09:32:14.404217 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 303/616] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:13 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:14.450054 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:14.451887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:14.467738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:14.468545 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:14.469592 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:14.470209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:14.542332 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4b784099-b7c2-4e77-b029-24660e2945b4 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094323 Jun 04 09:32:14.543640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 314/617] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:32:14 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:14.556630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:14.558277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:14.579532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:14.579983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:14.581252 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:14.584853 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:14.650426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ea2b9a9d-188e-4717-8282-48b5d32173e2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015" status: 200 len: 194 microversion: 2.1 time: 0.097826 Jun 04 09:32:14.651071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 304/618] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jun 4 09:32:14 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015 => generated 194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:15.031940 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:15.033027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:15.055846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:15.060105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:15.062052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:15.065519 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:15.427622 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:15.441054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:15.444894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:15.477931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:15.478680 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:15.480074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:15.480817 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:15.492492 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d3207f43-107c-49b3-88d0-4cf64419316d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.468205 Jun 04 09:32:15.497301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 315/619] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:15 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:15.998703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:16.016478 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:16.020176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:16.022850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d40d39ee-2d55-4484-bdfe-47d7a3435478 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.591321 Jun 04 09:32:16.025894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 305/620] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:15 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:16.208976 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-890b3187-f4c0-40c1-83a5-46576b4a28d9 req-50bfba28-991e-416c-9abc-ef0a5c094e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27", "tag": "cdbb24a2-9243-4d64-bc5f-fe72ab908821"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:16.248773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-890b3187-f4c0-40c1-83a5-46576b4a28d9 req-50bfba28-991e-416c-9abc-ef0a5c094e16 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:16.249526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-890b3187-f4c0-40c1-83a5-46576b4a28d9 req-50bfba28-991e-416c-9abc-ef0a5c094e16 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:16.295896 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-890b3187-f4c0-40c1-83a5-46576b4a28d9 req-50bfba28-991e-416c-9abc-ef0a5c094e16 service nova] Creating event network-changed:cdbb24a2-9243-4d64-bc5f-fe72ab908821 for instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 on hv-cinder-84469 Jun 04 09:32:16.310177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-890b3187-f4c0-40c1-83a5-46576b4a28d9 req-50bfba28-991e-416c-9abc-ef0a5c094e16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107743 Jun 04 09:32:16.312477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 316/621] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:16.522321 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:16.524740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:16.577591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:16.583985 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:16.586338 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:16.587482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:16.807182 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df6d2680-2a52-43a3-a387-2006ed0b569c"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:16.808409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:16.826979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:16.827434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:16.828630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:16.829072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:16.997706 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:17.011587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d1474258-738b-4f31-8d07-d71453450014 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.495544 Jun 04 09:32:17.016966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 306/622] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:16 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:17.051542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:17.052938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:17.081525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:17.082848 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:17.084751 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:17.087481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:17.435588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:17.447884 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:17.454274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:17.458379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:17.460746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-239c31d8-6b80-4529-9bec-a8dee0c958ec tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.416373 Jun 04 09:32:17.462562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 307/623] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:17 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:18.009597 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fe3b6d23-1d60-403b-8693-7deb2308f696 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "POST /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.208174 Jun 04 09:32:18.016724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 317/624] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:32:16 2022] POST /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 194 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:18.045121 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:18.047290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:18.061635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:18.067310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:18.067310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:18.067310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:18.236027 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:18.248760 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a90b2e8a-7aaa-4ed1-8123-41f09497199e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.210895 Jun 04 09:32:18.249566 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 308/625] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:18 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:18.515691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:18.517030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:18.526374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:18.527038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:18.528009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:18.528715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:19.095952 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:19.100818 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:19.114515 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:19.116782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:19.119360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-958a259a-4ec4-4be7-b618-0a906e0321d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.634902 Jun 04 09:32:19.136605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 318/626] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:18 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:19.292914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:19.297037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:19.305175 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:19.306881 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:19.318984 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:19.320804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:19.322578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:19.324417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:19.787698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:19.825842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-db201350-42c2-46be-8659-cf38558b49ea tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.534168 Jun 04 09:32:19.827658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 309/627] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:19 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:20.144998 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:20.147187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:20.151658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:20.163320 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:20.164418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:20.166699 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:20.168071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:20.541310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:20.553781 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:20.555453 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:20.556900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49fea376-6581-4b72-8832-518fc0a94aa9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.420852 Jun 04 09:32:20.568355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 319/628] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:20 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:20.857529 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:20.861627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:20.877205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:20.878405 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:20.880173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:20.881291 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:21.156627 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:21.171129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4aa01150-ca3a-4bd2-bc4e-4e897fdf16ff tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.321703 Jun 04 09:32:21.171979 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 310/629] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:20 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:21.588610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:21.590182 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:21.608329 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:21.608782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:21.613707 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:21.614330 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:21.824423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:21.834690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:21.836279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:21.852687 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-df38c1f2-45cf-4344-ad8b-3355c06cc2d8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.265822 Jun 04 09:32:21.855941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 320/630] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:21 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:22.201258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:22.202857 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:22.210170 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:22.210883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:22.211868 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:22.212497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:22.425994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:22.439236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8e383324-13b3-4796-a67d-c3794be1239b tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.244107 Jun 04 09:32:22.448676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 311/631] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:22 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:22.874809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:22.875550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:22.883891 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:22.884419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:22.885287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:22.885735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:23.088432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:23.098760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:23.100926 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:23.102740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3af9624c-dbf8-4570-9d79-5943ffed1f65 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.232047 Jun 04 09:32:23.103589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 321/632] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:22 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:23.461435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:23.462311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:23.470240 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:23.472710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:23.473795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:23.474695 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:23.475301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:23.677736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:23.687465 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-efc4a92a-7e7b-4c12-9673-f216a2ee0b62 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.231074 Jun 04 09:32:23.697449 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 312/633] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:23 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:32:23.785271 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-11ee0e09-3f4c-4146-b398-df4c8c37937a req-1cd525e4-80c0-4b54-af2c-34235ed43346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27", "name": "network-vif-plugged", "status": "completed", "tag": "cdbb24a2-9243-4d64-bc5f-fe72ab908821"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:23.804231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-11ee0e09-3f4c-4146-b398-df4c8c37937a req-1cd525e4-80c0-4b54-af2c-34235ed43346 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:23.806456 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-11ee0e09-3f4c-4146-b398-df4c8c37937a req-1cd525e4-80c0-4b54-af2c-34235ed43346 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:23.835991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-11ee0e09-3f4c-4146-b398-df4c8c37937a req-1cd525e4-80c0-4b54-af2c-34235ed43346 service nova] Creating event network-vif-plugged:cdbb24a2-9243-4d64-bc5f-fe72ab908821 for instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 on hv-cinder-84469 Jun 04 09:32:23.857316 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-11ee0e09-3f4c-4146-b398-df4c8c37937a req-1cd525e4-80c0-4b54-af2c-34235ed43346 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079232 Jun 04 09:32:23.859159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 322/634] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:24.124587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:24.125813 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:24.138144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:24.138951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:24.140505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:24.141298 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:24.318147 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:24.327735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:24.329717 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:24.331063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-85639a90-f47d-42c5-856b-5b41b9045614 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.212525 Jun 04 09:32:24.331654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 313/635] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:24 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:24.710444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:24.717035 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:24.727587 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:24.728669 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:24.730372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:24.731869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:24.925649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:24.940878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8fe5d906-f428-490b-87a1-35ae17fdd7e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.237418 Jun 04 09:32:24.952242 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 323/636] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:24 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:25.351439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:25.352089 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:25.365031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:25.365667 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:25.366586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:25.367130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:25.542883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:25.555110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:25.557927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:25.560683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2d445546-6cd9-4a8e-96f8-e9984f91b43b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1739 microversion: 2.20 time: 0.213626 Jun 04 09:32:25.561590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 314/637] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:25 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:25.967116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:25.968231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:25.976317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:25.976852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:25.977574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:25.978188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:26.136231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:26.145366 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-59c8ebff-de35-4716-886b-5428f75c5a53 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1368 microversion: 2.1 time: 0.183813 Jun 04 09:32:26.145977 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 324/638] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:25 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:26.579868 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:26.580994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:26.588266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:26.588850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:26.589649 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:26.590618 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:26.852918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:26.867480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:26.870709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:26.872573 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cb94c0a4-e6c9-49e8-bb0f-0ac9676564b5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1721 microversion: 2.20 time: 0.297135 Jun 04 09:32:26.875326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 315/639] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:26 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:27.163696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:27.164536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:27.172167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.172648 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:27.173434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.173859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:27.393623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:27.403830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-347dc2e6-7f31-446c-a6de-98afd63b63a0 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1559 microversion: 2.1 time: 0.244038 Jun 04 09:32:27.404229 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 325/640] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:27 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:27.428211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:27.428968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:27.436957 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.437457 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:27.438845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.438845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:27.601906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4e90cf3c-9d32-434d-b434-41ded00c6f0c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179190 Jun 04 09:32:27.608531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 316/641] 10.222.0.46 () {58 vars in 1274 bytes} [Sat Jun 4 09:32:27 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:27.906883 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:27.908566 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:27.922724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.923833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:27.925201 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:27.925923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.125178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:28.143657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:28.146280 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:28.149278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3ad4b906-05aa-4857-bbd0-5c338a9d7a19 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1721 microversion: 2.20 time: 0.249959 Jun 04 09:32:28.152413 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 326/642] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:27 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:28.259626 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:28.268686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:28.274844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.275366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.276177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.276642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.316268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-44f6473f-5ad8-4894-b03f-153dd2cffd6d tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062047 Jun 04 09:32:28.316884 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 317/643] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:32:28 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:28.478082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:28.478978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:28.491276 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.497875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.497875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.497875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.553957 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6741ab7f-e86d-4fba-ad6c-b6bd2d8fcdf9 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015" status: 200 len: 194 microversion: 2.1 time: 0.083424 Jun 04 09:32:28.555468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 327/644] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jun 4 09:32:28 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:28.569236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:28.570502 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:28.582017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.582794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.584148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:28.585039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:28.688879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lazy-loading 'services' on Instance uuid 97db5d68-dcb7-483a-b0ed-a1142e4ca67d {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:32:29.097523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f4b9fe6-03ad-4c66-9455-644439c6bb69 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015" status: 202 len: 0 microversion: 2.1 time: 0.535032 Jun 04 09:32:29.105283 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 318/645] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:32:28 2022] DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/95b09a27-8041-4374-8dfe-b8abf9f86015 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:32:29.187082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:29.188660 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:29.216782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:29.216782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:29.216782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:29.222444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:29.546955 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:29.561819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:29.563833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:29.565142 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-07c3796d-f29a-488b-b480-b9c2011246d1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1721 microversion: 2.20 time: 0.391599 Jun 04 09:32:29.577442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 328/646] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:29 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:29.600274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-adf852cf-33b6-45bd-aae0-5a3ce5e9fd5d req-3c735861-7f6b-4565-8c17-6028d0a4385b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "name": "network-vif-unplugged", "status": "completed", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:29.617627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-adf852cf-33b6-45bd-aae0-5a3ce5e9fd5d req-3c735861-7f6b-4565-8c17-6028d0a4385b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:29.618382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-adf852cf-33b6-45bd-aae0-5a3ce5e9fd5d req-3c735861-7f6b-4565-8c17-6028d0a4385b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:29.634159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-adf852cf-33b6-45bd-aae0-5a3ce5e9fd5d req-3c735861-7f6b-4565-8c17-6028d0a4385b service nova] Creating event network-vif-unplugged:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:32:29.640951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-adf852cf-33b6-45bd-aae0-5a3ce5e9fd5d req-3c735861-7f6b-4565-8c17-6028d0a4385b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044362 Jun 04 09:32:29.642143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 329/647] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:29.692032 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-c1fdc55d-0964-471b-8528-e61c5f700f32 req-08417d51-3bc7-4278-86c2-973a19c61cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27", "tag": "cdbb24a2-9243-4d64-bc5f-fe72ab908821"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:29.701040 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c1fdc55d-0964-471b-8528-e61c5f700f32 req-08417d51-3bc7-4278-86c2-973a19c61cf1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:29.701516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c1fdc55d-0964-471b-8528-e61c5f700f32 req-08417d51-3bc7-4278-86c2-973a19c61cf1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:29.714337 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-c1fdc55d-0964-471b-8528-e61c5f700f32 req-08417d51-3bc7-4278-86c2-973a19c61cf1 service nova] Creating event network-changed:cdbb24a2-9243-4d64-bc5f-fe72ab908821 for instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 on hv-cinder-84469 Jun 04 09:32:29.719964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-c1fdc55d-0964-471b-8528-e61c5f700f32 req-08417d51-3bc7-4278-86c2-973a19c61cf1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298241 Jun 04 09:32:29.722933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 319/648] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:30.585200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:30.586056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:30.593535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:30.593981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:30.594793 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:30.595235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:30.912909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:30.929928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:30.933361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:30.935992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2603a1d2-6774-414a-821d-32431d0f2c0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1724 microversion: 2.20 time: 0.355672 Jun 04 09:32:30.937850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 330/649] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:30 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:30.958889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d079c0a-de5f-4a53-be5f-814f2fa001cd"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:30.960218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:30.968864 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:30.971845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:30.971845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:30.971845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:31.924908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:31.925567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:31.932816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:31.933274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:31.934838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:31.935336 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:31.970854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-23e21399-1b43-48a4-aa6a-96fb438a788c tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/df6d2680-2a52-43a3-a387-2006ed0b569c" status: 200 len: 194 microversion: 2.1 time: 0.050200 Jun 04 09:32:31.971775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 331/650] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Jun 4 09:32:31 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/df6d2680-2a52-43a3-a387-2006ed0b569c => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:31.982521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:31.983022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:31.992514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:31.992514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:31.992514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:31.992514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:32.112523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lazy-loading 'services' on Instance uuid 97db5d68-dcb7-483a-b0ed-a1142e4ca67d {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:32:32.463210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d9322689-b7f2-4c10-b708-1f1c07c126a2 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/df6d2680-2a52-43a3-a387-2006ed0b569c" status: 202 len: 0 microversion: 2.1 time: 0.484353 Jun 04 09:32:32.463830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 332/651] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:32:31 2022] DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments/df6d2680-2a52-43a3-a387-2006ed0b569c => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:32:32.623633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9910ea29-f0cf-40ba-8c20-0b08d3454b3c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.671213 Jun 04 09:32:32.625067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 320/652] 10.222.0.46 () {62 vars in 1363 bytes} [Sat Jun 4 09:32:30 2022] POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments => generated 188 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 09:32:32.763788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:32.765062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:32.776105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:32.777124 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:32.778965 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:32.779696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:35.244570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:35.378701 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9138331d-1bf5-4b23-a4d9-09a968e94cbb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments/4d079c0a-de5f-4a53-be5f-814f2fa001cd" status: 202 len: 0 microversion: 2.20 time: 2.623068 Jun 04 09:32:35.379466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 333/653] 10.222.0.46 () {60 vars in 1456 bytes} [Sat Jun 4 09:32:32 2022] DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments/4d079c0a-de5f-4a53-be5f-814f2fa001cd => generated 0 bytes in 2626 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:32:35.448106 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:35.449686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:35.463621 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:35.464424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:35.466795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:35.468023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:35.573147 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:35.805029 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4dffaebe-92ac-4fc3-9281-da58cb8be1cb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/action" status: 202 len: 0 microversion: 2.20 time: 0.367080 Jun 04 09:32:35.806242 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 321/654] 10.222.0.46 () {62 vars in 1318 bytes} [Sat Jun 4 09:32:35 2022] POST /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:32:35.815371 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:35.816071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:35.823444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:35.823816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:35.825244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:35.825681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:35.995462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:36.013170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:36.017070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:36.019224 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c49e7506-a82a-4b56-ae8b-83410c8be839 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1672 microversion: 2.20 time: 0.207513 Jun 04 09:32:36.020351 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 334/655] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:35 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1672 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:36.889858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:36.891568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:36.904988 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:36.905975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:36.907523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:36.909202 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:36.959696 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d449806-3132-4428-94e0-0e7e3035c64b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079610 Jun 04 09:32:36.960556 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 322/656] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:32:36 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:32:37.042465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:37.042465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:37.051032 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.051575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.052663 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.053208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.146775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:37.146775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:37.149568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.150195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.151147 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.151769 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.202523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ba3e41a2-f374-47b6-917e-2e1f08f660ef tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069878 Jun 04 09:32:37.204474 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 323/657] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:32:37 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 09:32:37.279038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:37.304804 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:37.310374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:37.313822 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7355fe92-b57b-4145-a713-ee43ff100943 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1672 microversion: 2.20 time: 0.276903 Jun 04 09:32:37.314452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 335/658] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:37 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:37.317938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:37.318782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:37.327396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.327878 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.328711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.329153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.358555 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:32:37.680200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8645bbac-282c-4e9a-ac5f-84553387092b tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 204 len: 0 microversion: 2.1 time: 0.367282 Jun 04 09:32:37.680949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 324/659] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:32:37 2022] DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:32:37.691030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:37.691695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:37.699677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.700324 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.701315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:37.701855 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:37.858426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:37.866743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4edc02ec-f604-400e-8773-4a49f1436157 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1675 microversion: 2.1 time: 0.180083 Jun 04 09:32:37.867327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 336/660] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:37 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:38.347616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:38.348966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:38.360642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:38.361429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:38.362846 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:38.363598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:38.562373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:38.577223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:38.580759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:38.583236 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d4fd4a2b-97e4-4494-8f99-d458314446c5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1672 microversion: 2.20 time: 0.244408 Jun 04 09:32:38.584360 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 325/661] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:38 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1672 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:38.884776 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:38.885482 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:38.888396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=66 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:38.894496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:38.896453 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:38.896453 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:38.896453 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:39.054198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:39.068170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bc1baa9b-58ff-473d-bbc7-34027c3dcbc7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1675 microversion: 2.1 time: 0.187106 Jun 04 09:32:39.069270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 337/662] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:38 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:39.609263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:39.610353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:39.624102 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:39.624941 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:39.626286 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:39.627041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:39.916773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:39.927490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:39.929727 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:39.931409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bfe1954e-95cc-4c27-9e1b-290404b102a4 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1674 microversion: 2.20 time: 0.329919 Jun 04 09:32:39.932278 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 326/663] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:39 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1674 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:40.092541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:40.093725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:40.106462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:40.107266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:40.108739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:40.109550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:40.372409 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:40.383576 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-04d0f999-f6a2-4865-b379-964f9df4c6a8 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1675 microversion: 2.1 time: 0.298708 Jun 04 09:32:40.384945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 338/664] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:40 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1675 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:40.968943 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:40.968943 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:40.974768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:40.975591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:40.977223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:40.978026 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:41.412805 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:41.414010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:41.431938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:41.433843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:41.436604 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:41.438174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:41.448660 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:41.495160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:41.503792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:41.507094 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4f43b05-ffb9-4169-bed7-8b7815e749d5 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.558942 Jun 04 09:32:41.512733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 327/665] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:40 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:41.591623 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-4353f902-61eb-4113-b4fc-b1be144c2184 req-eb838c76-0a70-4b7c-98ac-9220964e6bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97db5d68-dcb7-483a-b0ed-a1142e4ca67d", "name": "network-vif-deleted", "tag": "3c4bc68d-872f-414a-b54e-4885dd81a4e7"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:41.608910 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4353f902-61eb-4113-b4fc-b1be144c2184 req-eb838c76-0a70-4b7c-98ac-9220964e6bfc service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:41.609758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4353f902-61eb-4113-b4fc-b1be144c2184 req-eb838c76-0a70-4b7c-98ac-9220964e6bfc service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:41.624248 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:41.632999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2c5d464b-770f-4bd4-906e-740e437f1e79 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1608 microversion: 2.1 time: 0.228483 Jun 04 09:32:41.633620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 339/666] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:41 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1608 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:32:41.641333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-4353f902-61eb-4113-b4fc-b1be144c2184 req-eb838c76-0a70-4b7c-98ac-9220964e6bfc service nova] Creating event network-vif-deleted:3c4bc68d-872f-414a-b54e-4885dd81a4e7 for instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d on hv-cinder-84469 Jun 04 09:32:41.654328 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-4353f902-61eb-4113-b4fc-b1be144c2184 req-eb838c76-0a70-4b7c-98ac-9220964e6bfc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069805 Jun 04 09:32:41.656856 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 328/667] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:32:42.544739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:42.545941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:42.560122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:42.560924 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:42.562290 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:42.563009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:42.654839 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:42.655656 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:42.668497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:42.669231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:42.674075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:42.675740 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:42.751560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:42.752053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:42.752547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lazy-loading 'fault' on Instance uuid 97db5d68-dcb7-483a-b0ed-a1142e4ca67d {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:32:42.856523 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac869ff528aa49989c88b3a545ba9cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e27e8df485ff405e965cf22847c3b262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:42.863728 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:42.868546 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-535da6ca-f13a-4575-b4c9-c9c178eadf8f tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 200 len: 1328 microversion: 2.1 time: 0.220853 Jun 04 09:32:42.880623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:42.882876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 329/668] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:42 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 1328 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:32:42.883935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:42.892619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-318c385f-d339-4a23-9a7d-6e53ed0b91d9 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.354781 Jun 04 09:32:42.893621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 340/669] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:42 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:43.894255 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:43.896689 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:43.912442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:43.913231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:43.914912 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:43.924823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:43.926980 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:43.928063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:43.954747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:43.961056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:43.968768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:43.972439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:43.988873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d HTTP/1.1 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:32:43.997909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:44.000497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '97db5d68-dcb7-483a-b0ed-a1142e4ca67d'} Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:44.002920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:44.006745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:44.015574 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:44.017464 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d95948d9-38c2-46df-b639-e721a85e9b88 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 404 len: 111 microversion: 2.1 time: 0.129311 Jun 04 09:32:44.025884 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 330/670] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:43 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:44.035110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5d453e8b-5c9b-40b0-aa20-94f5cabfa3c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '.version_select at 0x7fa415cd0dc0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:44.185870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5d453e8b-5c9b-40b0-aa20-94f5cabfa3c7 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646427805" status: 202 len: 0 microversion: 2.1 time: 0.157563 Jun 04 09:32:44.188636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 331/671] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jun 4 09:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646427805 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:32:44.401049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:44.427048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:44.429508 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:44.431198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09c0d02c-849d-4329-8744-58c9f699c34c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.513767 Jun 04 09:32:44.445428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 341/672] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:43 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:45.458211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:45.460477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:45.480185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:45.481483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:45.483338 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:45.484832 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:45.758420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:45.787804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:45.791993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:45.804261 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-be06464e-47ac-4ee7-afe3-2c94e33afce7 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.350870 Jun 04 09:32:45.830927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 332/673] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:45 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:46.841447 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:46.845073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:46.858130 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:46.858923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:46.860416 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:46.861374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:47.100196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:47.113553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:47.115535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:47.117661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1c95f257-1e31-44d4-95f7-82bb8f8951b1 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.285536 Jun 04 09:32:47.119163 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 342/674] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:46 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:48.155460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:48.161756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:48.174891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:48.175663 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:48.181889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:48.181889 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:48.553103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:48.566117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:48.567741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:48.571804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9c7e2aed-1340-4bb1-9143-7e28df1e7eae tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.424487 Jun 04 09:32:48.586320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 333/675] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:48 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:49.610392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:49.612878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:49.627671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:49.628950 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:49.630661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:49.631765 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:49.904455 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:49.904982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:49.922484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:49.922949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:49.923837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:49.924321 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:49.953947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d HTTP/1.1 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:32:49.955953 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:49.957742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '97db5d68-dcb7-483a-b0ed-a1142e4ca67d'} Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:49.959130 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:49.960797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:49.964945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:49.964945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b585f08e-7117-4c17-bf46-d97afe96bb5a tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 404 len: 111 microversion: 2.1 time: 0.057608 Jun 04 09:32:49.964945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 334/676] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:32:49 2022] DELETE /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:49.979260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:49.979998 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: 97db5d68-dcb7-483a-b0ed-a1142e4ca67d] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:49.993359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:49.996577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:49.998795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:50.000596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:50.020165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d HTTP/1.1 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:32:50.022331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:50.023876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '97db5d68-dcb7-483a-b0ed-a1142e4ca67d'} Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:50.024833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. Jun 04 09:32:50.026596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:50.029647 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance 97db5d68-dcb7-483a-b0ed-a1142e4ca67d could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:50.030745 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ec33487e-d67e-4821-b9ac-bb2bbb154f10 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d" status: 404 len: 111 microversion: 2.1 time: 0.064538 Jun 04 09:32:50.038246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 335/677] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:49 2022] GET /compute/v2.1/servers/97db5d68-dcb7-483a-b0ed-a1142e4ca67d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:50.054991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:50.073989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:50.080071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:50.086580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7004c45c-345f-46ef-87b8-93c357c84027 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.493476 Jun 04 09:32:50.087631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 343/678] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:49 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:51.132068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:51.134762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:51.162252 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.164100 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.166294 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.170200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.484890 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:51.497570 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:51.503868 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:51.503868 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-29072336-46ab-452d-b008-932dbfcb442b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.385478 Jun 04 09:32:51.503868 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 336/679] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:51 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:51.785406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:51.786827 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:51.796331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.796842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.797972 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.798459 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.817895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e HTTP/1.1 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:32:51.820317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.825808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'ffde7de1-13e8-4ea6-98d2-d07a19afee2e'} Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:51.826815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.829256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.831866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:51.831866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1f6ef183-3a6c-4bdb-a79c-03f2f9051581 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 404 len: 111 microversion: 2.1 time: 0.041657 Jun 04 09:32:51.831866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 344/680] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:32:51 2022] DELETE /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:51.837483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:51.838609 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] [instance: ffde7de1-13e8-4ea6-98d2-d07a19afee2e] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:51.848655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.849660 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.851462 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:51.852455 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:51.881654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] HTTP exception thrown: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Request method failure captured: Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e HTTP/1.1 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVEJ8w-rsv--eQ8FB9IpiC9M-1NvY2YDzT3Y7SS0BFvxlLnpw0lqMyQAUijV1ENbIM375Ad1vfVcdbO0CnXOO9tVW6S4m4tMZBWrMvBnm2GCvkeFEPaOUEewWXi_sqp5rk-7o923ldZfphfaF-wQnt5_NN1bA9mYJZ-RyBoJgw3aaQ Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:32:51.885616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e27e8df485ff405e965cf22847c3b262", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e27e8df485ff405e965cf22847c3b262"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: e27e8df485ff405e965cf22847c3b262 Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361725470 Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: ac869ff528aa49989c88b3a545ba9cf1 Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeTestJSON-361725470-project Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.888250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'ffde7de1-13e8-4ea6-98d2-d07a19afee2e'} Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:32:51.891067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. Jun 04 09:32:51.896116 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:32:51.903949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] Returning 404 to user: Instance ffde7de1-13e8-4ea6-98d2-d07a19afee2e could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:32:51.903949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8abe219a-6f1e-4226-b083-3c0402133242 tempest-AttachVolumeTestJSON-361725470 tempest-AttachVolumeTestJSON-361725470-project] 10.222.0.46 "GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e" status: 404 len: 111 microversion: 2.1 time: 0.058856 Jun 04 09:32:51.908924 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 337/681] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:32:51 2022] GET /compute/v2.1/servers/ffde7de1-13e8-4ea6-98d2-d07a19afee2e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:32:52.529887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:52.530796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:52.539407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:52.544458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:52.544458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:52.544458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:52.892694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:52.903235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:52.905421 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:52.907153 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c8a6e411-b3a0-4a68-9ac3-8becc0510bf6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.383828 Jun 04 09:32:52.908180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 345/682] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:52 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:32:53.935884 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:53.936630 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:53.944560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:53.945028 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:53.945843 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:53.946287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:54.109058 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:54.119214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:54.121720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:54.123218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-493c9779-be3c-496a-9cb8-8a0477ed4822 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.192168 Jun 04 09:32:54.124006 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 338/683] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:53 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:55.155790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:55.157005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:55.169392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:55.170256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:55.171756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:55.172845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:55.363950 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:55.379712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:55.387730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:55.387730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cb365d67-2f95-449c-821c-88166e0b6412 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.239757 Jun 04 09:32:55.393973 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 346/684] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:55 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:56.413669 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:56.414982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:56.417347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:56.424458 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:56.425175 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:56.426182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:56.426787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:56.578819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:56.588074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:56.589754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:56.590979 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e495cf02-dfa4-42f4-909b-8f8bb09b6e0e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.181831 Jun 04 09:32:56.591547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 339/685] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:56 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:57.622417 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:57.623260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:57.632831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:57.633427 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:57.634485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:57.635076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:57.847722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:57.860794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:57.863751 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:57.865909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ff96edfb-e6e5-4108-9a1e-fe6e8020db0b tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.250245 Jun 04 09:32:57.866868 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 347/686] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:57 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:32:57.892988 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-9ce52dc1-ccf3-4217-b2bf-c577d29f73ce req-a1ba796e-0b7c-4562-ab3c-ea379a8d9f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "name": "network-vif-plugged", "status": "completed", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:32:57.908560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9ce52dc1-ccf3-4217-b2bf-c577d29f73ce req-a1ba796e-0b7c-4562-ab3c-ea379a8d9f4b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:57.909054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9ce52dc1-ccf3-4217-b2bf-c577d29f73ce req-a1ba796e-0b7c-4562-ab3c-ea379a8d9f4b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:57.914119 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:32:57.922936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-9ce52dc1-ccf3-4217-b2bf-c577d29f73ce req-a1ba796e-0b7c-4562-ab3c-ea379a8d9f4b service nova] Creating event network-vif-plugged:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:32:57.940659 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-9ce52dc1-ccf3-4217-b2bf-c577d29f73ce req-a1ba796e-0b7c-4562-ab3c-ea379a8d9f4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055794 Jun 04 09:32:57.941438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 340/687] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:32:58.901370 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:32:58.902610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:32:58.915543 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:58.916340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:58.917729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:32:58.918480 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:32:59.083945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:59.093200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:59.095112 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:32:59.096623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-83080b88-2936-436d-954a-eb6eb156dacb tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.202886 Jun 04 09:32:59.097196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 348/688] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:32:58 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:00.125424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:00.126592 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:00.141107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:00.142282 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:00.143647 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:00.144430 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:00.492693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:00.515257 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:00.525989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:00.525989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7b9aa48f-156c-44c9-b980-6198d84442f8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.404722 Jun 04 09:33:00.525989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 341/689] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:00 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:01.546558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:01.547236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:01.554726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:01.555175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:01.555961 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:01.556443 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:01.728635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:01.743875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:01.748197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:01.750773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fe14f2a4-19df-49b6-821f-6f9ae6cdb33f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1730 microversion: 2.20 time: 0.211558 Jun 04 09:33:01.751433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 349/690] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:01 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:02.780044 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:02.781352 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:02.795476 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:02.796235 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:02.797300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:02.797743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:02.978480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:02.998087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:02.998087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:02.999054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2a79aac1-53aa-4b9a-8023-1d7764247836 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1717 microversion: 2.20 time: 0.227335 Jun 04 09:33:02.999999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 342/691] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:02 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1717 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:05.863430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:05.864830 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:05.879944 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:05.880747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:05.882106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:05.882864 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:05.918301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e9fe13f-7aef-4ff8-9ca6-7218ee4b7b6a tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/ips" status: 200 len: 151 microversion: 2.1 time: 0.073037 Jun 04 09:33:05.918908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 350/692] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:33:05 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:33:07.899820 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614620f7-996d-42fe-b759-94ab8cdb96aa"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:33:07.901825 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:07.910722 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:07.911487 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:07.912553 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:07.913117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:08.876864 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-544f594a-49e2-47bd-ad2c-1aa4bb7832f3 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "POST /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.983475 Jun 04 09:33:08.877980 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 343/693] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:33:07 2022] POST /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:18.923804 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:18.924657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:18.927049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=27 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:18.928178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:18.934446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:18.934893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:18.935762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:18.936200 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:19.054187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'services' on Instance uuid a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:33:19.459481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ebf4f2de-6f74-4587-8c52-bc38640e5056 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments/614620f7-996d-42fe-b759-94ab8cdb96aa" status: 202 len: 0 microversion: 2.1 time: 0.539056 Jun 04 09:33:19.464506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 351/694] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:33:18 2022] DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments/614620f7-996d-42fe-b759-94ab8cdb96aa => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:33:19.469492 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=9 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:19.471411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:19.480312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:19.482188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:19.490347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:19.491033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:19.491970 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:19.492578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:19.527997 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b7a5b835-aee3-4d40-8798-f322f53a2e4f tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061367 Jun 04 09:33:19.528796 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 344/695] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:33:19 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:20.542909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:20.544315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:20.551233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:20.551686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:20.552518 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:20.552968 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:20.593567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-77e3c034-febe-459b-bc89-2aa890f13fcb tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055906 Jun 04 09:33:20.599049 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 352/696] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:33:20 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:33:21.611349 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:21.613177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:21.631678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:21.631678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:21.631678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:21.632159 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:21.693404 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b13ef42d-057e-4da5-8894-1136c3fed79d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088503 Jun 04 09:33:21.694351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 345/697] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:33:21 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:33:21.792624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:21.793408 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:21.801338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:21.801785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:21.802803 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:21.803236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:21.835532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:33:22.555070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4b4ca1d2-ebfc-49b3-bf8e-30c380036223 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 204 len: 0 microversion: 2.1 time: 0.766568 Jun 04 09:33:22.555861 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 353/698] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:33:21 2022] DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:33:22.569793 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:22.570845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:22.582301 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:22.583063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:22.584460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:22.585218 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:22.756141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:22.771425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7ae94a9c-1341-4fa7-b475-77ca67e793e8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1684 microversion: 2.1 time: 0.209077 Jun 04 09:33:22.772435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 346/699] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:22 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1684 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:33:23.804859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:23.807186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:23.833188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:23.833188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:23.833188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:23.833188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:24.035383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:24.045097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6563234b-bce1-4967-a82b-079f490c98dd tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1684 microversion: 2.1 time: 0.248565 Jun 04 09:33:24.046039 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 354/700] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:23 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1684 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:33:25.065813 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:25.066959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:25.076165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:25.077051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:25.077975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:25.078588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:25.174276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:25.189249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-da268e22-9ed0-4bfb-93ac-e510813cef8c tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1616 microversion: 2.1 time: 0.129052 Jun 04 09:33:25.190019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 347/701] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:25 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1616 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:33:25.616629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-42ea9fde-bdaf-4fd5-8341-ae80f70f3f06 req-f971543d-98fc-48a9-905a-2b9ab41a5ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27", "name": "network-vif-deleted", "tag": "cdbb24a2-9243-4d64-bc5f-fe72ab908821"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:33:25.638994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-42ea9fde-bdaf-4fd5-8341-ae80f70f3f06 req-f971543d-98fc-48a9-905a-2b9ab41a5ad3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:25.639435 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-42ea9fde-bdaf-4fd5-8341-ae80f70f3f06 req-f971543d-98fc-48a9-905a-2b9ab41a5ad3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:25.651854 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-42ea9fde-bdaf-4fd5-8341-ae80f70f3f06 req-f971543d-98fc-48a9-905a-2b9ab41a5ad3 service nova] Creating event network-vif-deleted:cdbb24a2-9243-4d64-bc5f-fe72ab908821 for instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 on hv-cinder-84469 Jun 04 09:33:25.657418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-42ea9fde-bdaf-4fd5-8341-ae80f70f3f06 req-f971543d-98fc-48a9-905a-2b9ab41a5ad3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051105 Jun 04 09:33:25.658677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 355/702] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:26.213593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:26.214842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:26.228456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:26.229366 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:26.230897 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:26.232512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:26.291081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:26.291968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:26.292878 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lazy-loading 'fault' on Instance uuid a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:33:26.391686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeffa44fe38a4204ae21b52fe827cedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7410684ee8db448d8385de8549bce1a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:26.411240 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ac1b1363-728d-4f64-9279-54a838297ebc tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 200 len: 1332 microversion: 2.1 time: 0.203583 Jun 04 09:33:26.412335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 348/703] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:26 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 1332 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:33:26.576931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:33:26.577196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:33:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:33:27.437240 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:27.438046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:27.446680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:27.447189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:27.448107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:27.448632 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:27.464042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 HTTP/1.1 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:27.465789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:27.468391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27'} Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:27.470033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:27.473004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:27.475465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:27.475465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-296a2800-b638-4596-b66a-c774ccdb1d8d tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 404 len: 111 microversion: 2.1 time: 0.036103 Jun 04 09:33:27.475465 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 356/704] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:27 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:27.482392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-53908d7b-c47f-462f-bd36-8123af5acd45 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '.version_select at 0x7fa415d73670>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:27.601312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-53908d7b-c47f-462f-bd36-8123af5acd45 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353995034" status: 202 len: 0 microversion: 2.1 time: 0.124979 Jun 04 09:33:27.602181 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 349/705] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Jun 4 09:33:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1353995034 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:33:30.082345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:30.083352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:30.098832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:30.098832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:30.099245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:30.099920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:30.127853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 HTTP/1.1 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:30.130988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.133638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27'} Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:30.139368 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.142040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.144602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:30.144602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-65faa359-370f-419c-8449-e4b4eb49ce84 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 404 len: 111 microversion: 2.1 time: 0.059381 Jun 04 09:33:30.144602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 357/706] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:33:30 2022] DELETE /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:30.149095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:30.150123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:30.159970 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:30.160452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:30.161248 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:30.161689 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:30.176972 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 HTTP/1.1 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:30.178807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.181925 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27'} Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:30.183310 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. Jun 04 09:33:30.185343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:30.186720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:30.186720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bf135aef-d8ec-4876-8467-1eab279d2f42 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27" status: 404 len: 111 microversion: 2.1 time: 0.039180 Jun 04 09:33:30.186720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 350/707] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:30 2022] GET /compute/v2.1/servers/a86901bd-e9c3-4c4d-9a4a-b5e3c4c13a27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:31.562195 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:31.563158 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:31.575362 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.576070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.577449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.578150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.604411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 HTTP/1.1 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:31.607189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.609788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'dd93bd20-00a2-47ab-ba82-3009fdfcf7c7'} Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:31.611196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.614865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.618008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:31.618008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e9fa1f9c-b22d-405d-b8ff-f03b03dfaf1e tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 404 len: 111 microversion: 2.1 time: 0.055345 Jun 04 09:33:31.618008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 358/708] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:33:31 2022] DELETE /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:31.623157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:31.624475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: dd93bd20-00a2-47ab-ba82-3009fdfcf7c7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:31.633003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.633622 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.635139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.635697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.653231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 HTTP/1.1 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:31.655434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.658358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'dd93bd20-00a2-47ab-ba82-3009fdfcf7c7'} Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:31.659930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. Jun 04 09:33:31.662146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.664131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:31.664131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fa8ebaac-3695-4108-b438-637d9304ec80 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7" status: 404 len: 111 microversion: 2.1 time: 0.040653 Jun 04 09:33:31.664131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 351/709] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:31 2022] GET /compute/v2.1/servers/dd93bd20-00a2-47ab-ba82-3009fdfcf7c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:31.669248 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:31.669839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:31.677396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.679255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.679255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.679255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.694846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 HTTP/1.1 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:31.697146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.699411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '40117894-5b54-4a57-9b6c-b0e8a3dc0af3'} Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:31.700848 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.702487 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.704785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:31.704785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-54431610-5660-414c-820b-97d7a6f03346 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 404 len: 111 microversion: 2.1 time: 0.033490 Jun 04 09:33:31.704785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 359/710] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:33:31 2022] DELETE /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:31.711257 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:31.712230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 40117894-5b54-4a57-9b6c-b0e8a3dc0af3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:31.720336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.720693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.721488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:31.722594 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:31.738547 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 HTTP/1.1 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:31.740114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.742682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '40117894-5b54-4a57-9b6c-b0e8a3dc0af3'} Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:31.744658 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. Jun 04 09:33:31.746896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:31.751038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 40117894-5b54-4a57-9b6c-b0e8a3dc0af3 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:31.751038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-41ccf9ae-b84b-4ba4-bbdc-8f52bbb3afe7 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3" status: 404 len: 111 microversion: 2.1 time: 0.035869 Jun 04 09:33:31.751038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 352/711] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:31 2022] GET /compute/v2.1/servers/40117894-5b54-4a57-9b6c-b0e8a3dc0af3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:32.193364 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:32.194785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:32.204621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.205273 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:32.206302 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.206743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:32.242828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-215d8ba7-edc5-4609-95c2-7113e43da675 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054453 Jun 04 09:33:32.244307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 360/712] 10.222.0.46 () {60 vars in 1342 bytes} [Sat Jun 4 09:33:32 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:33:32.393576 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:32.394387 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:32.408768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.409801 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:32.412197 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.413003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:32.459786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:33:32.874409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f168c2c5-1532-4bc9-a73a-4de241703a95 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 204 len: 0 microversion: 2.20 time: 0.486822 Jun 04 09:33:32.875499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 353/713] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jun 4 09:33:32 2022] DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 09:33:32.884954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:32.885630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:32.892779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.893236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:32.894034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:32.894476 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:33.083136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:33.093567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:33.097540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:33.102253 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7fe1b8c1-d735-4a8b-8b2b-8d4da2705c15 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.220019 Jun 04 09:33:33.118728 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 361/714] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:32 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:33.136084 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:33.136652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:33.144263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:33.145088 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:33.146287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:33.146915 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:33.165599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 HTTP/1.1 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:33.167749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.170528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '63c900d7-98de-4ba9-a6d7-98bc2194c582'} Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:33.172510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.176276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.181420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:33.181420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9a2cd3a9-3716-4a76-a754-5f248cb92bf4 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 404 len: 111 microversion: 2.1 time: 0.039607 Jun 04 09:33:33.181420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 354/715] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:33:33 2022] DELETE /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:33.183634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:33.184522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] [instance: 63c900d7-98de-4ba9-a6d7-98bc2194c582] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:33.192631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:33.193305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:33.194232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:33.194778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:33.213534 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] HTTP exception thrown: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Request method failure captured: Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 HTTP/1.1 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVPmzAbyr9JVFoNWGALA2XZetzBK9jxl7pj6zKfgykqfl7puXFVVkCmJOCJMuQUSjVu3QMfbZ6IWtAxoRbyguJSNcNel-Gt8LyWV227wZX2XNUbZZuH0FAuN7gsFY_KwIIoIeSE3bX9zV9z5BuCR_r63ihwf7jP6XrtbcoXq344hec Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:33.215192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7410684ee8db448d8385de8549bce1a7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7410684ee8db448d8385de8549bce1a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7410684ee8db448d8385de8549bce1a7 Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1594369825 Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: aeffa44fe38a4204ae21b52fe827cedc Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeNegativeTest-1594369825-project Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.218369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '63c900d7-98de-4ba9-a6d7-98bc2194c582'} Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:33.219646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. Jun 04 09:33:33.223252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:33.225842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] Returning 404 to user: Instance 63c900d7-98de-4ba9-a6d7-98bc2194c582 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:33.225842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-33c55c2e-7b9f-4745-b436-8bc2c34e2bc8 tempest-AttachVolumeNegativeTest-1594369825 tempest-AttachVolumeNegativeTest-1594369825-project] 10.222.0.46 "GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582" status: 404 len: 111 microversion: 2.1 time: 0.040165 Jun 04 09:33:33.225842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 362/716] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:33:33 2022] GET /compute/v2.1/servers/63c900d7-98de-4ba9-a6d7-98bc2194c582 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:33:34.138322 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:34.139847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:34.154947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:34.157145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:34.159906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:34.161805 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:34.590127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:34.609442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:34.613093 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:34.620598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c834d1f6-ecaa-423a-8b51-0a39040fcfd6 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1723 microversion: 2.20 time: 0.487047 Jun 04 09:33:34.620598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 355/717] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:34 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:35.656785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:35.656785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:35.666566 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:35.667356 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:35.668530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:35.669144 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:35.860319 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:35.882172 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:35.886670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:35.889489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-18c13b78-0321-4f2c-8f63-8758f8bf7431 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1655 microversion: 2.20 time: 0.246538 Jun 04 09:33:35.891188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 363/718] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:35 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 09:33:36.435732 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-3cf261de-7fe0-44e2-a45d-9bb6d36f59bc req-df3a5522-49aa-474c-98f4-a40ebebe7985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520e177e-a9b1-47c1-b519-1c53bf52bc2a", "name": "network-vif-deleted", "tag": "6e772a52-7e16-406e-b953-3df1c61c710b"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:33:36.453682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-3cf261de-7fe0-44e2-a45d-9bb6d36f59bc req-df3a5522-49aa-474c-98f4-a40ebebe7985 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:36.454854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-3cf261de-7fe0-44e2-a45d-9bb6d36f59bc req-df3a5522-49aa-474c-98f4-a40ebebe7985 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:36.478196 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-3cf261de-7fe0-44e2-a45d-9bb6d36f59bc req-df3a5522-49aa-474c-98f4-a40ebebe7985 service nova] Creating event network-vif-deleted:6e772a52-7e16-406e-b953-3df1c61c710b for instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a on hv-cinder-84469 Jun 04 09:33:36.487709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-3cf261de-7fe0-44e2-a45d-9bb6d36f59bc req-df3a5522-49aa-474c-98f4-a40ebebe7985 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059088 Jun 04 09:33:36.488906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 356/719] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:33:36.924006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:36.927900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:36.941971 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:36.943209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:36.948936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:36.950308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:37.032006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:37.033783 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:37.035025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lazy-loading 'fault' on Instance uuid 520e177e-a9b1-47c1-b519-1c53bf52bc2a {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:33:37.435271 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:37.481582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:37.482953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b6676edfa984008b846589b2df9ef92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cf07261800e47938626f61a1fb73b2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:33:37.485327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-88224eca-7a12-4274-8076-4a15f848b70e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 200 len: 1370 microversion: 2.20 time: 0.569804 Jun 04 09:33:37.486681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 364/720] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:36 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 1370 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 09:33:38.522505 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:38.523742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:38.535496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:38.536207 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:38.537731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:38.538637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:38.559019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a HTTP/1.1 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:38.562188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:38.565336 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '520e177e-a9b1-47c1-b519-1c53bf52bc2a'} Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:38.567223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:38.569892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:38.573923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:38.575054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a2981889-9e7a-4492-aa6e-b5ae68f06330 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 404 len: 111 microversion: 2.20 time: 0.059855 Jun 04 09:33:38.575794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 357/721] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:38 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 04 09:33:38.589361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a5708e82-11d6-4783-803b-63eeb001cbf0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '.version_select at 0x7fa4153da160>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:38.688315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a5708e82-11d6-4783-803b-63eeb001cbf0 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469374808" status: 204 len: 0 microversion: 2.20 time: 0.104903 Jun 04 09:33:38.699143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 365/722] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Jun 4 09:33:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469374808 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 04 09:33:41.877629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:41.878316 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:41.885696 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:41.886211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:41.887120 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:41.887919 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:41.905924 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a HTTP/1.1 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:41.907497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.909967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '520e177e-a9b1-47c1-b519-1c53bf52bc2a'} Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:41.911945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.915434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.918117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:41.918117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0143ca67-aec1-46be-bca4-8176a619e57c tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 404 len: 111 microversion: 2.20 time: 0.036323 Jun 04 09:33:41.918117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 358/723] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jun 4 09:33:41 2022] DELETE /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 04 09:33:41.921778 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:41.922608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 520e177e-a9b1-47c1-b519-1c53bf52bc2a] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:41.931602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:41.932081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:41.932961 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:41.933480 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:41.948516 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a HTTP/1.1 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:41.950179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.954046 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '520e177e-a9b1-47c1-b519-1c53bf52bc2a'} Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:41.956103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. Jun 04 09:33:41.958893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:41.962189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 520e177e-a9b1-47c1-b519-1c53bf52bc2a could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:41.962189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-52b356e2-efd7-4940-9bc5-54be2b4694a8 tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a" status: 404 len: 111 microversion: 2.20 time: 0.034741 Jun 04 09:33:41.962189 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 366/724] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:41 2022] GET /compute/v2.1/servers/520e177e-a9b1-47c1-b519-1c53bf52bc2a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 04 09:33:43.337779 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-60a708c9-46df-40f8-a8fd-b18e4490d807 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Action: 'create', calling method: .version_select at 0x7fa415c60550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1452238626", "metadata": {"Type": "work"}}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:33:44.199343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-60a708c9-46df-40f8-a8fd-b18e4490d807 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.009313 Jun 04 09:33:44.199998 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 359/725] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Jun 4 09:33:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1011 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 04 09:33:44.213115 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4de90da2-7004-4f5c-b4bf-9fc1ad185083 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa41546b430>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:44.267209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4de90da2-7004-4f5c-b4bf-9fc1ad185083 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.059567 Jun 04 09:33:44.267929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 367/726] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:44 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:45.281382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-45c68958-dce0-4708-8ef3-77fd37ac5420 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa415e19790>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:45.337871 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-45c68958-dce0-4708-8ef3-77fd37ac5420 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.060887 Jun 04 09:33:45.338496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 360/727] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:45 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:46.352941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b637979c-9072-4e69-a333-1f78b89014fc tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa4153da670>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:46.406325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b637979c-9072-4e69-a333-1f78b89014fc tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.058488 Jun 04 09:33:46.406964 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 368/728] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:46 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:47.419997 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5b99aa23-4739-4289-a102-564e51150fa4 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa415c83d30>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:47.472782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5b99aa23-4739-4289-a102-564e51150fa4 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.057122 Jun 04 09:33:47.473364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 361/729] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:47 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:48.487100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-99c9b120-b0b7-4f14-a675-623ebebfb85a tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa4153c6dc0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:48.549463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-99c9b120-b0b7-4f14-a675-623ebebfb85a tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.067199 Jun 04 09:33:48.550674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 369/730] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:48 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:49.565534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-14a5008b-953f-466b-ae24-19bc2666df66 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa415ea1dc0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:49.621137 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-14a5008b-953f-466b-ae24-19bc2666df66 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.060291 Jun 04 09:33:49.621825 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 362/731] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:49 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:50.639820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-daa2e421-ad8a-450e-842a-fbbb4c049cf4 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa4153c6ca0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:50.710801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-daa2e421-ad8a-450e-842a-fbbb4c049cf4 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 354 microversion: 2.1 time: 0.076687 Jun 04 09:33:50.710801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 370/732] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:50 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:50.726071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a602e111-fe4a-4915-adc1-85e61079d89d tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa415e2f550>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:50.792647 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a602e111-fe4a-4915-adc1-85e61079d89d tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 354 microversion: 2.1 time: 0.073045 Jun 04 09:33:50.793321 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 363/733] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:50 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:33:50.814365 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a696330e-4597-470b-9ea9-bf654abcc8b3 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa41538db80>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:51.121292 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a696330e-4597-470b-9ea9-bf654abcc8b3 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 202 len: 0 microversion: 2.1 time: 0.311354 Jun 04 09:33:51.122505 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 371/734] 10.222.0.46 () {58 vars in 1247 bytes} [Sat Jun 4 09:33:50 2022] DELETE /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:33:51.131753 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-60f24ab4-2f1a-41b1-bdae-b9ba5f0b48ba tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa415c60160>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:51.187428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-60f24ab4-2f1a-41b1-bdae-b9ba5f0b48ba tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 200 len: 353 microversion: 2.1 time: 0.060075 Jun 04 09:33:51.188005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 364/735] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:51 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:33:51.819881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:51.825738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:51.825738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:51.829201 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:51.829658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:51.830506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:51.830940 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:51.834030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:51.847436 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 HTTP/1.1 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:51.849165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.859490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '61c71590-e9f8-4f50-a859-a54c2f2d0ae2'} Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:51.861070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.864083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.867650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:51.867650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a9cf7784-ee6f-47df-b98a-0364dfaab32e tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 404 len: 111 microversion: 2.20 time: 0.035621 Jun 04 09:33:51.867650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 372/736] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Jun 4 09:33:51 2022] DELETE /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:33:51.868077 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:51.868831 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] [instance: 61c71590-e9f8-4f50-a859-a54c2f2d0ae2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:33:51.872634 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:33:51.878041 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:51.878492 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:51.879298 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:33:51.879709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:33:51.899729 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] HTTP exception thrown: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Request method failure captured: Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 HTTP/1.1 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyVJi0MY5Tpw_-Cb9vUgcWirc5FL1bsLRsxWuCOKdlc3ip6G1WhFew9HWxN7cTuELr63XEqmxaGSiDgpYZQ5sBDJQ7DMJynaeshVUFA5Kvmtd9DxEEYuCPkWUNN6_u_eOHXVtEg3O-5-D7xFul_g74RboC7UVXxwaGUr8yxCqT7VxQw Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:33:51.901344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0cf07261800e47938626f61a1fb73b2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0cf07261800e47938626f61a1fb73b2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 0cf07261800e47938626f61a1fb73b2b Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-390993312 Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 7b6676edfa984008b846589b2df9ef92 Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-390993312-project Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.904148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '61c71590-e9f8-4f50-a859-a54c2f2d0ae2'} Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:51.905788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. Jun 04 09:33:51.908435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:33:51.910629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] Returning 404 to user: Instance 61c71590-e9f8-4f50-a859-a54c2f2d0ae2 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:51.910629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0e378ebf-7ca0-453b-93f2-17fe85e6798f tempest-AttachVolumeShelveTestJSON-390993312 tempest-AttachVolumeShelveTestJSON-390993312-project] 10.222.0.46 "GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2" status: 404 len: 111 microversion: 2.20 time: 0.045657 Jun 04 09:33:51.910629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 365/737] 10.222.0.46 () {60 vars in 1276 bytes} [Sat Jun 4 09:33:51 2022] GET /compute/v2.1/servers/61c71590-e9f8-4f50-a859-a54c2f2d0ae2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 09:33:52.202646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ffcd94b-fa5b-4961-a7fc-7758e7fb2f84 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Calling method '.version_select at 0x7fa41546b700>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:33:52.239393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-4ffcd94b-fa5b-4961-a7fc-7758e7fb2f84 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] HTTP exception thrown: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ffcd94b-fa5b-4961-a7fc-7758e7fb2f84 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Request method failure captured: Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 HTTP/1.1 Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyb3eYcKVJSxkep2BaEtONxMYiTN9xnbKKKkt-07jYpwqJEbVplG6verDOv2EHzRNzkOvcqJwVr7Pd0MzhyH4y2I-Crw90qVBufSyusy4JEP1HqHJ5HvJVv3Ry4vsGCv9Pp7ZCYF9XtAHQU2WY2_gvoMHYajZYC1y6d5x-DPaGUuNXY Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 7b85ac9b4cc34b888bd9fb1f12b6e35b Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesGetTestJSON-1685683659 Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:33:52.245428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7b85ac9b4cc34b888bd9fb1f12b6e35b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7b85ac9b4cc34b888bd9fb1f12b6e35b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7b85ac9b4cc34b888bd9fb1f12b6e35b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7b85ac9b4cc34b888bd9fb1f12b6e35b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesGetTestJSON-1685683659 Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 7b85ac9b4cc34b888bd9fb1f12b6e35b Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesGetTestJSON-1685683659 Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesGetTestJSON-1685683659-project Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: f39bed050e1b4b0abff0d64735354ca0 Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesGetTestJSON-1685683659-project Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'ea4c4406-b62a-4d6b-9a5f-ecbe034aa654'} Jun 04 09:33:52.246852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. (HTTP 404) (Request-ID: req-8a38a4e9-6b3e-4c46-9688-df030695e2c9) Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:52.247725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 09:33:52.251730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 09:33:52.253307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ffcd94b-fa5b-4961-a7fc-7758e7fb2f84 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] Returning 404 to user: Volume ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:33:52.254645 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ffcd94b-fa5b-4961-a7fc-7758e7fb2f84 tempest-VolumesGetTestJSON-1685683659 tempest-VolumesGetTestJSON-1685683659-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654" status: 404 len: 109 microversion: 2.1 time: 0.052623 Jun 04 09:33:52.256158 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 373/738] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:33:52 2022] GET /compute/v2.1/os-volumes/ea4c4406-b62a-4d6b-9a5f-ecbe034aa654 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:34:05.750307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f649be0-01c9-407a-8450-4d48c6850322 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415c60e50>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:05.758208 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:05.808134 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f649be0-01c9-407a-8450-4d48c6850322 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/db96dfe6-2093-406b-bb0a-8a427b9b9f12" status: 200 len: 351 microversion: 2.1 time: 0.062296 Jun 04 09:34:05.808714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 366/739] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:34:05 2022] GET /compute/v2.1/os-volumes/db96dfe6-2093-406b-bb0a-8a427b9b9f12 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:07.858157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-811a931f-1e2f-4b6c-9ecc-405c0c33805b tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa41541cee0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:07.933338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-811a931f-1e2f-4b6c-9ecc-405c0c33805b tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/bde39d06-e8cc-48e3-ba4c-7925ed5b93da" status: 200 len: 351 microversion: 2.1 time: 0.086358 Jun 04 09:34:07.934546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 374/740] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:34:07 2022] GET /compute/v2.1/os-volumes/bde39d06-e8cc-48e3-ba4c-7925ed5b93da => generated 351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:11.182249 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-31c9d651-9534-45b2-b091-350080ec6e35 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415cf19d0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:11.262678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-31c9d651-9534-45b2-b091-350080ec6e35 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8b229c33-5445-4e62-8acc-f42b2100f98c" status: 200 len: 350 microversion: 2.1 time: 0.087638 Jun 04 09:34:11.263877 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 367/741] 10.222.0.46 () {58 vars in 1244 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes/8b229c33-5445-4e62-8acc-f42b2100f98c => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:11.286733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-271f80b6-f938-4583-8661-a7d6136910fa tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa41544be50>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:11.392910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-271f80b6-f938-4583-8661-a7d6136910fa tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.116138 Jun 04 09:34:11.393525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 375/742] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:11.406907 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a77c1f06-6afb-47da-9db3-14c329b26087 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415ea1790>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:11.573319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a77c1f06-6afb-47da-9db3-14c329b26087 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.170168 Jun 04 09:34:11.574383 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 368/743] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:11.595058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4cd1592a-ff43-4409-a632-0db588579337 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa41558c040>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:11.767317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4cd1592a-ff43-4409-a632-0db588579337 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.177315 Jun 04 09:34:11.767906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 376/744] 10.222.0.46 () {58 vars in 1133 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:11.783940 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ce0afb8d-6d86-400d-9094-8991141ef4e5 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415cf14c0>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:11.931117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ce0afb8d-6d86-400d-9094-8991141ef4e5 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154906 Jun 04 09:34:11.931695 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 369/745] 10.222.0.46 () {58 vars in 1166 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:11.950299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ce758d2-7352-43e9-b069-c2a0c7e88d90 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa4156000d0>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:12.111700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ce758d2-7352-43e9-b069-c2a0c7e88d90 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165245 Jun 04 09:34:12.112698 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 377/746] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Jun 4 09:34:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:12.132389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75dee90a-c5e8-49c5-992f-bf22a23dbb25 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415c4ab80>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:12.235222 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75dee90a-c5e8-49c5-992f-bf22a23dbb25 tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.110267 Jun 04 09:34:12.236034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 370/747] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jun 4 09:34:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:12.247733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f9cc437-fbbd-496c-8f9a-48aa24ae212e tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415600940>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:12.346989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f9cc437-fbbd-496c-8f9a-48aa24ae212e tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102884 Jun 04 09:34:12.348338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 378/748] 10.222.0.46 () {58 vars in 1187 bytes} [Sat Jun 4 09:34:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:12.360389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c27fa126-d918-44e6-956c-aa1ca72468ee tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] Calling method '.version_select at 0x7fa415cf1820>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:12.463644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c27fa126-d918-44e6-956c-aa1ca72468ee tempest-VolumesTestJSON-490969440 tempest-VolumesTestJSON-490969440-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.107096 Jun 04 09:34:12.464652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 371/749] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Jun 4 09:34:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:38.068332 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:38.072536 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:38.076172 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-313725630", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "networks": [{"uuid": "fdf2a67e-f50b-4289-bb54-6da3ac9e4ca0"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:34:38.208715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] validate_networks() for [('fdf2a67e-f50b-4289-bb54-6da3ac9e4ca0', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:34:39.125658 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:34:39.127808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:34:39.129501 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:34:39.130619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:34:39.132119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:34:39.154852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:39.154852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:39.154852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:39.154852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:39.191123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Getting quotas for project fff077a9afa543b2b239071f9c79ac38. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:34:39.197234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Getting quotas for user 078a0f5285624b5f82b80e53a3a68ef9 and project fff077a9afa543b2b239071f9c79ac38. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:34:39.217111 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:34:39.221365 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:34:39.493463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4ecece92-4b62-494f-b467-01dd50cd56c4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426941 Jun 04 09:34:39.495016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 379/750] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:34:39.504439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:39.513590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-58ea92e1-bbb8-4955-84eb-a8bf0bb27b7b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:39.514562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-58ea92e1-bbb8-4955-84eb-a8bf0bb27b7b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:39.612186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-58ea92e1-bbb8-4955-84eb-a8bf0bb27b7b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:39.627789 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-58ea92e1-bbb8-4955-84eb-a8bf0bb27b7b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1213 microversion: 2.1 time: 0.125426 Jun 04 09:34:39.628986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 372/751] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:39 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:40.646951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a57d0f0c-03f9-438e-bf87-094b9a9a88ed tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:40.647672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a57d0f0c-03f9-438e-bf87-094b9a9a88ed tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:40.711260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a57d0f0c-03f9-438e-bf87-094b9a9a88ed tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:40.718875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a57d0f0c-03f9-438e-bf87-094b9a9a88ed tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1213 microversion: 2.1 time: 0.076637 Jun 04 09:34:40.719470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 380/752] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:40 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:41.756747 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:41.766461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:41.792571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:41.793586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:41.795350 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:41.797152 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:41.926548 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:41.941655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4779944a-905f-435b-92a5-c8430138a2e1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1217 microversion: 2.1 time: 0.206174 Jun 04 09:34:41.957379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 373/753] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:41 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:42.974032 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:42.975237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:43.010082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:43.011633 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:43.016215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:43.018006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:43.383052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:43.397294 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a94a4d92-31da-4dc7-9071-59cfbacf1c90 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1265 microversion: 2.1 time: 0.430911 Jun 04 09:34:43.399196 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 381/754] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:42 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:44.424443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:44.424443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:44.440996 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:44.441617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:44.447077 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:44.448024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:44.666360 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:44.670281 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9d83a4c4-2e3b-40e2-88c9-899a9bc1d948 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1283 microversion: 2.1 time: 0.250862 Jun 04 09:34:44.681620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 374/755] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:44 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:34:45.691929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:45.693080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:45.705961 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:45.706629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:45.720649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:45.722058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:45.840180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:45.866969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-52f286fb-0828-4d59-88da-79535bf443b1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1271 microversion: 2.1 time: 0.180893 Jun 04 09:34:45.889862 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 382/756] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:45 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:46.899475 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:46.900936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:46.909045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:46.909661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:46.910571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:46.911125 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:47.134741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:47.172425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-894f3445-8f24-4863-8000-0782c6fa470f tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.266954 Jun 04 09:34:47.172425 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 375/757] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:46 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:34:48.190893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:48.191732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:48.198746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:48.201069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:48.201069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:48.201069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:48.574747 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:48.635626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-44b85363-0913-41ea-911e-0c86edfaa3dd tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.448941 Jun 04 09:34:48.636809 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 383/758] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:48 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:49.622594 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:49.667820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:49.669192 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:49.678632 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:49.695445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:49.702840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:49.703971 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:49.704691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:49.983052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:49.992576 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bba14d96-17a2-45f2-84de-297139313720 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.338341 Jun 04 09:34:49.995460 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 384/759] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:49 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:50.002000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-4379f25e-7b00-42df-a19b-00cf7e1dce9a req-2c6fe92a-4928-41c7-8b82-286e093b9cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd13560-16de-4158-84a8-c3357f9592b3", "tag": "bec806a5-2eaa-4ade-8bcc-3def81d49d7f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:34:50.012265 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4379f25e-7b00-42df-a19b-00cf7e1dce9a req-2c6fe92a-4928-41c7-8b82-286e093b9cfb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:50.012738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-4379f25e-7b00-42df-a19b-00cf7e1dce9a req-2c6fe92a-4928-41c7-8b82-286e093b9cfb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:50.031796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-4379f25e-7b00-42df-a19b-00cf7e1dce9a req-2c6fe92a-4928-41c7-8b82-286e093b9cfb service nova] Creating event network-changed:bec806a5-2eaa-4ade-8bcc-3def81d49d7f for instance 1cd13560-16de-4158-84a8-c3357f9592b3 on hv-cinder-84469 Jun 04 09:34:50.034752 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-4379f25e-7b00-42df-a19b-00cf7e1dce9a req-2c6fe92a-4928-41c7-8b82-286e093b9cfb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036282 Jun 04 09:34:50.035495 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 385/760] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:34:50.052629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c9988b0e-c093-4139-a2e1-2ff576a581f6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Action: 'create', calling method: .version_select at 0x7fa415ea1a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-2065999011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKA5+jNPhawYs40wb/2zFIfbHOB4GOp91je3v/2M0qZXNBXmm1VD7tLdj4agx4Z1lAgosLobIVe53UaECFNs/gIzD+EQ9aFhYzlqomI5+T9M7OoAd9sdIaExCcOClfpgoA=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:34:50.072050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-c9988b0e-c093-4139-a2e1-2ff576a581f6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Getting quotas for project d7bc412a2d2f4fc68c2a9f3562232807. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:34:50.077348 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-c9988b0e-c093-4139-a2e1-2ff576a581f6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Getting quotas for user 79755c3f9eec4c5ab3e98038015bff32 and project d7bc412a2d2f4fc68c2a9f3562232807. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:34:50.185693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c9988b0e-c093-4139-a2e1-2ff576a581f6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.622670 Jun 04 09:34:50.186770 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 376/761] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:34:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:34:51.019649 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:34:51.025225 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:51.025994 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:51.033621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:51.034544 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:51.035291 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:51.035725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:51.307318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:51.317328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-16d49fe7-c08c-408d-91af-823ffa97b591 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.298998 Jun 04 09:34:51.317914 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 386/762] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:51 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:52.347459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:52.348529 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:52.359299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:52.360941 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:52.362474 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:52.363421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:52.588608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:52.600375 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9ed1253d-6d0e-4676-a703-2b42251340af tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.259576 Jun 04 09:34:52.601909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 377/763] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:52 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:53.620853 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:53.626562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:53.632839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:53.633510 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:53.634908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:53.635674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:53.891072 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:53.906018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4aecf11d-534d-4797-ab59-482f39b7aac1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.290864 Jun 04 09:34:53.907079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 387/764] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:53 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:54.928879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:54.930499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:54.937629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:54.938081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:54.938875 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:54.939309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:55.117352 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:55.127869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e59ff183-0b14-44fb-969a-7fd855a36843 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.204450 Jun 04 09:34:55.128499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 378/765] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:54 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:56.154014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:56.156760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:56.177063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:56.178786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:56.180048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:56.180837 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:56.388234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:56.397700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8a37a1de-e3ee-4bbc-b563-911e7429e23e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.255599 Jun 04 09:34:56.398609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 388/766] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:56 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:34:57.415707 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:57.416530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:57.425406 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:57.425995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:57.427027 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:57.427744 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:57.634050 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:57.649530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-095f000d-619f-4144-a47d-4eb1489a890c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.237623 Jun 04 09:34:57.650602 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 379/767] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:57 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:34:57.730693 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-47b28a90-ddf6-4d5a-90c7-b3fc861b7a70 req-f1b1823f-ef91-4a65-a1b1-a8a8b3cca9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd13560-16de-4158-84a8-c3357f9592b3", "name": "network-vif-plugged", "status": "completed", "tag": "bec806a5-2eaa-4ade-8bcc-3def81d49d7f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:34:57.748238 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-47b28a90-ddf6-4d5a-90c7-b3fc861b7a70 req-f1b1823f-ef91-4a65-a1b1-a8a8b3cca9c0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:57.749103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-47b28a90-ddf6-4d5a-90c7-b3fc861b7a70 req-f1b1823f-ef91-4a65-a1b1-a8a8b3cca9c0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:57.763287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-47b28a90-ddf6-4d5a-90c7-b3fc861b7a70 req-f1b1823f-ef91-4a65-a1b1-a8a8b3cca9c0 service nova] Creating event network-vif-plugged:bec806a5-2eaa-4ade-8bcc-3def81d49d7f for instance 1cd13560-16de-4158-84a8-c3357f9592b3 on hv-cinder-84469 Jun 04 09:34:57.768635 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-47b28a90-ddf6-4d5a-90c7-b3fc861b7a70 req-f1b1823f-ef91-4a65-a1b1-a8a8b3cca9c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042320 Jun 04 09:34:57.769262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 389/768] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:34:58.676267 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:58.677151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:58.683928 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:58.684530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:58.685327 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:58.685768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:58.859120 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:34:58.868015 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dc31fb68-9870-4a4d-88dd-ab52fe9ea7e5 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.196724 Jun 04 09:34:58.868688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 380/769] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:58 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:34:59.887876 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:34:59.888546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:34:59.895220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:59.895709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:34:59.897133 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:34:59.897571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:00.040113 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:00.048145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3f6dcd4b-79e8-40a4-ac7c-52579f24affb tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.165079 Jun 04 09:35:00.048798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 390/770] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:34:59 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:01.067904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:01.069080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:01.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:01.084051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:01.084691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:01.085759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:01.086261 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:01.299426 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:01.317674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8d9eb129-5808-4496-a811-f4e3f34209c9 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.254552 Jun 04 09:35:01.322193 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 381/771] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:01 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:02.340030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:02.340942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:02.350052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:02.350859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:02.351858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:02.352584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:02.515167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:02.523532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-532f0c11-5d33-46f0-a555-f6ea88c3fa85 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1313 microversion: 2.1 time: 0.187871 Jun 04 09:35:02.524123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 391/772] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:02 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:03.542056 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:03.542885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:03.549840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:03.555668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:03.555668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:03.555668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:03.742513 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:03.751075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-392d369c-5eeb-4ec1-b356-c13256a73590 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1497 microversion: 2.1 time: 0.213033 Jun 04 09:35:03.751936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 382/773] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:03 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:04.961554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:04.961554 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:04.969117 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:04.969567 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:04.970375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:04.970811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:05.007175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:35:05.514799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ea8ec46f-0f98-4728-af2d-9ebea2baf354 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 204 len: 0 microversion: 2.1 time: 0.557244 Jun 04 09:35:05.518818 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 392/774] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:35:04 2022] DELETE /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:35:05.535023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:05.535795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:05.543562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:05.544020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:05.544846 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:05.545485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:05.734295 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:05.749708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f1aa7953-4779-4dd3-a7ab-1c3ef74bdc33 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1503 microversion: 2.1 time: 0.217946 Jun 04 09:35:05.750746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 383/775] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:05 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:06.779405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:06.787269 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:06.787269 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:06.788103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:06.788464 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:06.788963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:06.972120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:06.980481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5b52b7b-bc1b-406d-83f1-e7dcf752abc6 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1503 microversion: 2.1 time: 0.206269 Jun 04 09:35:06.981131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 393/776] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:06 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1503 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:08.008096 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:08.008909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:08.016870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:08.017590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:08.020233 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:08.022177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:08.151767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:08.174652 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-65d788cb-73a5-41cb-b142-370dc81c08e5 req-8b873493-7c4a-4ad7-93ce-c876e6b79f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd13560-16de-4158-84a8-c3357f9592b3", "name": "network-vif-deleted", "tag": "bec806a5-2eaa-4ade-8bcc-3def81d49d7f"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:08.177263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c11837d6-21d2-4ee1-a199-277eac123f17 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1461 microversion: 2.1 time: 0.173189 Jun 04 09:35:08.182714 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 384/777] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:08 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1461 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:08.191843 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-65d788cb-73a5-41cb-b142-370dc81c08e5 req-8b873493-7c4a-4ad7-93ce-c876e6b79f20 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:08.193621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-65d788cb-73a5-41cb-b142-370dc81c08e5 req-8b873493-7c4a-4ad7-93ce-c876e6b79f20 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:08.218135 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-65d788cb-73a5-41cb-b142-370dc81c08e5 req-8b873493-7c4a-4ad7-93ce-c876e6b79f20 service nova] Creating event network-vif-deleted:bec806a5-2eaa-4ade-8bcc-3def81d49d7f for instance 1cd13560-16de-4158-84a8-c3357f9592b3 on hv-cinder-84469 Jun 04 09:35:08.226985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-65d788cb-73a5-41cb-b142-370dc81c08e5 req-8b873493-7c4a-4ad7-93ce-c876e6b79f20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062359 Jun 04 09:35:08.237191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 394/778] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:09.211287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:09.212613 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:09.224906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:09.225424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:09.226885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:09.227677 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:09.280859 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:09.281604 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:09.282253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lazy-loading 'fault' on Instance uuid 1cd13560-16de-4158-84a8-c3357f9592b3 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:35:09.326494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:09.334859 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-172b231b-c348-4c99-81ff-d7eda74bca2b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 200 len: 1303 microversion: 2.1 time: 0.131057 Jun 04 09:35:09.335356 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 385/779] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:09 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:10.357904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:10.359131 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 1cd13560-16de-4158-84a8-c3357f9592b3] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:10.362810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:10.370038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:10.370789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:10.371763 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:10.372401 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:10.396461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:10.398787 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] HTTP exception thrown: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Request method failure captured: Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 HTTP/1.1 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimycr1dhFjrRC4rEq0eSwyFQ5GePWQZUIkqF2X69mYiUa2T8IJxwQWfJtIZTONMCVDX5n4gTMw5Yt7o5D7iL4Y4GR5KumoYoOC73zSTQf_uu7o6G1QAuGeefh9CMwsz1u2SmchbK1cwvmq43GD3dO4rCzL68jvRfdYVWOxQLVJagTfaU Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: fff077a9afa543b2b239071f9c79ac38 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-VolumesActionsTest-485326456 Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:35:10.401714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fff077a9afa543b2b239071f9c79ac38", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-VolumesActionsTest-485326456 Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: fff077a9afa543b2b239071f9c79ac38 Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-VolumesActionsTest-485326456 Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-VolumesActionsTest-485326456-project Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 078a0f5285624b5f82b80e53a3a68ef9 Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-VolumesActionsTest-485326456-project Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. Jun 04 09:35:10.410243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '1cd13560-16de-4158-84a8-c3357f9592b3'} Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:35:10.411335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. Jun 04 09:35:10.412930 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:35:10.414429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Returning 404 to user: Instance 1cd13560-16de-4158-84a8-c3357f9592b3 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:35:10.414429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a081bc61-2a88-4c3f-b103-abb11f329b60 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3" status: 404 len: 111 microversion: 2.1 time: 0.053469 Jun 04 09:35:10.414429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 395/780] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:10 2022] GET /compute/v2.1/servers/1cd13560-16de-4158-84a8-c3357f9592b3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:35:10.590150 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1443189271", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "networks": [{"uuid": "fdf2a67e-f50b-4289-bb54-6da3ac9e4ca0"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:10.650315 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] validate_networks() for [('fdf2a67e-f50b-4289-bb54-6da3ac9e4ca0', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:35:11.083085 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:35:11.083522 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:35:11.084176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:35:11.084499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:35:11.084931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:35:11.095702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:11.096160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:11.097027 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:11.097462 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:11.105479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=75 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:11.118561 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Getting quotas for project fff077a9afa543b2b239071f9c79ac38. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:35:11.123750 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Getting quotas for user 078a0f5285624b5f82b80e53a3a68ef9 and project fff077a9afa543b2b239071f9c79ac38. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:35:11.143086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:35:11.146929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:35:11.316967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2610413b-56e9-483a-ac8b-bb15af9c519e tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731549 Jun 04 09:35:11.321370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 386/781] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:35:11.337464 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4a90ed12-aae8-48d6-b9cb-0a02df3e7107 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:11.339232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4a90ed12-aae8-48d6-b9cb-0a02df3e7107 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:11.407174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4a90ed12-aae8-48d6-b9cb-0a02df3e7107 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:11.416171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4a90ed12-aae8-48d6-b9cb-0a02df3e7107 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1214 microversion: 2.1 time: 0.085859 Jun 04 09:35:11.417428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 396/782] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:11 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:12.438963 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6d8e31fe-162f-4389-86a9-e9159f008cfa tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:12.440020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6d8e31fe-162f-4389-86a9-e9159f008cfa tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:12.445598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:12.530663 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6d8e31fe-162f-4389-86a9-e9159f008cfa tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:12.539466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6d8e31fe-162f-4389-86a9-e9159f008cfa tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1214 microversion: 2.1 time: 0.105413 Jun 04 09:35:12.540168 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 387/783] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:12 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:13.558164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:13.558732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:13.566881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:13.567425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:13.568324 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:13.568769 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:13.661773 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:13.674259 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cfb89ebc-ecf3-481f-9dd0-0a23b9e1a116 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1266 microversion: 2.1 time: 0.121148 Jun 04 09:35:13.675569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 397/784] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:13 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:14.699480 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:14.700717 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:14.719214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:14.720691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:14.721794 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:14.722532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:14.857873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:14.874033 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ed784cfe-615f-419e-92a7-949eedb5aaf4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1284 microversion: 2.1 time: 0.178694 Jun 04 09:35:14.875537 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 388/785] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:14 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:15.005995 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-259049048", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2065999011", "security_groups": [{"name": "tempest-secgroup-smoke-1182516507"}], "networks": [{"uuid": "091b8198-00d3-4e96-9948-78161854c494"}], "block_device_mapping_v2": [{"uuid": "b0e2857f-892f-48c2-bd8e-84c4257286fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:15.482927 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] validate_networks() for [('091b8198-00d3-4e96-9948-78161854c494', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:35:15.907144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:15.908433 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:15.921140 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:15.922049 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:15.923544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:15.924441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:16.278333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:35:16.279423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:35:16.279423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:35:16.279423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:35:16.279801 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:35:16.291620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:16.292063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:16.292558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:16.293395 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:16.293840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:16.306700 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf255aa7-177a-4505-aede-e972128f9d25 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.407327 Jun 04 09:35:16.308370 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 389/786] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:15 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:16.313326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Getting quotas for project d7bc412a2d2f4fc68c2a9f3562232807. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:35:16.318276 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Getting quotas for user 79755c3f9eec4c5ab3e98038015bff32 and project d7bc412a2d2f4fc68c2a9f3562232807. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:35:16.443426 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:35:16.445746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0e2857f-892f-48c2-bd8e-84c4257286fd',volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:35:16.534640 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-849430938", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:16.586332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] validate_networks() for None {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:35:17.107694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-656691d9-6365-43f0-bdca-c3648a8cf6c2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.107291 Jun 04 09:35:17.116828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 398/787] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:35:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:35:17.127486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b1e82a42-753c-4ebc-9e40-6033cd9af73c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:17.129001 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b1e82a42-753c-4ebc-9e40-6033cd9af73c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:17.232051 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b1e82a42-753c-4ebc-9e40-6033cd9af73c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:17.249864 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b1e82a42-753c-4ebc-9e40-6033cd9af73c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1088 microversion: 2.1 time: 0.130426 Jun 04 09:35:17.259455 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 399/788] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:17 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1088 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:17.325761 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:35:17.328061 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:35:17.329175 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:35:17.330187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:35:17.331464 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:35:17.332519 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:17.334160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:17.347178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:17.349929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:17.351057 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:17.351652 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:17.364599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:17.364599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:17.367285 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:17.368161 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:17.403995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Getting quotas for project ebe772f995f743118963aa8c85ab5c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:35:17.412968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Getting quotas for user 8f357411d6a547468e94697978f9ca6f and project ebe772f995f743118963aa8c85ab5c2b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:35:17.430362 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:35:17.432777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:35:17.582220 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:17.595877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ab93e223-cee4-4b7f-8188-2bf9d62b6d71 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.271533 Jun 04 09:35:17.597738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 400/789] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:17 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:17.601174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-72a55226-7706-4f36-bd93-088df29544f3 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070122 Jun 04 09:35:17.602762 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 390/790] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 09:35:17.617931 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-90b74531-da54-4dcd-b09d-f782bfd9a59e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:17.619397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-90b74531-da54-4dcd-b09d-f782bfd9a59e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:17.643359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-fe62558b-a282-4798-9ed6-b1398c7d79cd req-da685d95-b769-4f47-80ec-9ceef04da579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411bb645-ad60-430f-a941-e6de32757e60", "tag": "b4046c58-32f3-40fe-896b-4544fe89088c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:17.657781 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-fe62558b-a282-4798-9ed6-b1398c7d79cd req-da685d95-b769-4f47-80ec-9ceef04da579 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:17.658479 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-fe62558b-a282-4798-9ed6-b1398c7d79cd req-da685d95-b769-4f47-80ec-9ceef04da579 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:17.675023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-fe62558b-a282-4798-9ed6-b1398c7d79cd req-da685d95-b769-4f47-80ec-9ceef04da579 service nova] Creating event network-changed:b4046c58-32f3-40fe-896b-4544fe89088c for instance 411bb645-ad60-430f-a941-e6de32757e60 on hv-cinder-84469 Jun 04 09:35:17.678290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-fe62558b-a282-4798-9ed6-b1398c7d79cd req-da685d95-b769-4f47-80ec-9ceef04da579 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040404 Jun 04 09:35:17.678923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 391/791] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:35:17.742798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-90b74531-da54-4dcd-b09d-f782bfd9a59e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:17.752027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-90b74531-da54-4dcd-b09d-f782bfd9a59e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1214 microversion: 2.1 time: 0.139024 Jun 04 09:35:17.752757 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 401/792] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:17 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:18.275937 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-68215e51-6ef0-4678-996e-f0554afc468e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:18.276686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-68215e51-6ef0-4678-996e-f0554afc468e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:18.354838 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-68215e51-6ef0-4678-996e-f0554afc468e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:18.365263 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-68215e51-6ef0-4678-996e-f0554afc468e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1088 microversion: 2.1 time: 0.093641 Jun 04 09:35:18.366203 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 392/793] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:18 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:18.618060 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:18.621893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:18.640545 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:18.642620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:18.644277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:18.645938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:18.778701 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6c15eaab-dda3-4cd2-9b2c-c417a4400788 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:18.780179 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6c15eaab-dda3-4cd2-9b2c-c417a4400788 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:18.898633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6c15eaab-dda3-4cd2-9b2c-c417a4400788 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:18.906561 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:18.915708 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c88dffbe-ba83-4d3b-8414-6dd0076b9ece tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.303531 Jun 04 09:35:18.920579 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 402/794] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:18 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:19.071536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6c15eaab-dda3-4cd2-9b2c-c417a4400788 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1214 microversion: 2.1 time: 0.298614 Jun 04 09:35:19.072733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 393/795] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:18 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:19.387646 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:19.388266 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:19.394825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:19.395329 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:19.396712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:19.397152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:19.481689 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:19.493442 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-93e33146-10e1-426c-87af-16c39413ba12 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1138 microversion: 2.1 time: 0.109484 Jun 04 09:35:19.494474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 403/796] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:19 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1138 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:19.941713 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:19.943131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:19.950902 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:19.951361 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:19.952180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:19.952725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:20.091782 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:20.092984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:20.102482 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:20.102938 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:20.104184 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:20.104686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:20.113922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:20.126197 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-79cd33b6-b574-407f-b8b2-d4b93063ff59 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.188923 Jun 04 09:35:20.127136 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 394/797] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:19 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:20.196524 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:20.204790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-43712131-6500-4bf4-97d2-3481c97eac16 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1266 microversion: 2.1 time: 0.118924 Jun 04 09:35:20.205384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 404/798] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:20 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:20.521024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:20.522149 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:20.533330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:20.534123 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:20.535657 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:20.537038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:20.638879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:20.649466 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-72fadbcb-c80c-4acb-b45b-14f08887a2af tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1186 microversion: 2.1 time: 0.136463 Jun 04 09:35:20.659631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 395/799] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:20 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1186 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:21.149815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:21.151730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:21.166789 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.170054 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.171230 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.172630 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.222767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:21.223434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:21.231826 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.236220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.236220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.236220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.389473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:21.418304 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-02095afd-0e39-4901-aa5d-ac28bafcfc13 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1274 microversion: 2.1 time: 0.199314 Jun 04 09:35:21.419228 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 396/800] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:21 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:21.632921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:21.672209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5592be0-d4c8-4622-9251-5d1c06477d72 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.527435 Jun 04 09:35:21.672373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:21.673002 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:21.676234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 405/801] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:21 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:21.685837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.686876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.689660 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:21.690300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:21.854784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:21.876420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a9834ead-b32b-49d3-ab9d-bc57ae94105f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1204 microversion: 2.1 time: 0.201416 Jun 04 09:35:21.876420 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 397/802] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:21 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1204 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:22.439471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:22.444386 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:22.455589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.457031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:22.458805 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.459651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:22.579216 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:22.595036 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-76b51b9d-ffec-4bff-ae93-3b9833c48aba tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1272 microversion: 2.1 time: 0.159526 Jun 04 09:35:22.596632 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 406/803] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:22 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:22.691464 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:22.692751 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:22.709358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.709904 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:22.710722 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.711188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:22.894052 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:22.895233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:22.906330 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.907122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:22.908663 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:22.909433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:23.121914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:23.136633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c83043a3-9be0-404e-9a03-ba20f2332de1 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.448669 Jun 04 09:35:23.139090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 398/804] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:22 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:23.331859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:23.346136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-85587fd7-b9de-4df9-9942-1db3b422cb21 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.459557 Jun 04 09:35:23.347622 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 407/805] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:22 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:23.623818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:23.625995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:23.641377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:23.642639 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:23.644638 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:23.646599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:23.803268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-b601477a-8176-43d9-b42a-1e3e35d20111 req-c013343c-3cf7-4ca5-a7e2-2aa89371300a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411bb645-ad60-430f-a941-e6de32757e60", "name": "network-vif-plugged", "status": "completed", "tag": "b4046c58-32f3-40fe-896b-4544fe89088c"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:23.829699 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b601477a-8176-43d9-b42a-1e3e35d20111 req-c013343c-3cf7-4ca5-a7e2-2aa89371300a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:23.830822 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b601477a-8176-43d9-b42a-1e3e35d20111 req-c013343c-3cf7-4ca5-a7e2-2aa89371300a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:23.858792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-b601477a-8176-43d9-b42a-1e3e35d20111 req-c013343c-3cf7-4ca5-a7e2-2aa89371300a service nova] Creating event network-vif-plugged:b4046c58-32f3-40fe-896b-4544fe89088c for instance 411bb645-ad60-430f-a941-e6de32757e60 on hv-cinder-84469 Jun 04 09:35:23.869186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-b601477a-8176-43d9-b42a-1e3e35d20111 req-c013343c-3cf7-4ca5-a7e2-2aa89371300a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073618 Jun 04 09:35:23.871070 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 408/806] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:24.161551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:24.163244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:24.175288 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:24.176004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:24.177825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:24.178428 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:24.580959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:24.596260 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eb78f075-3d1d-49cb-be25-15deb58dad96 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.983934 Jun 04 09:35:24.608347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 399/807] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:23 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:24.608888 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:24.610463 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:24.623617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:24.624501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:24.625679 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:24.626596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:24.686942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:24.697326 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0f9783ac-4f5f-4deb-aff4-9b5c8f71ec13 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.541630 Jun 04 09:35:24.698877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 409/808] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:24 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:24.873371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:24.882229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ae091ae9-b188-4f43-9cdb-a48ea4a75947 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.282217 Jun 04 09:35:24.882836 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 400/809] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:24 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:25.084694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-10967dec-8f1a-4357-bfc8-988bedb39f90 req-b6c885b0-476c-4468-8a10-d3d751400e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:25.111759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-10967dec-8f1a-4357-bfc8-988bedb39f90 req-b6c885b0-476c-4468-8a10-d3d751400e0b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:25.112523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-10967dec-8f1a-4357-bfc8-988bedb39f90 req-b6c885b0-476c-4468-8a10-d3d751400e0b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:25.132529 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-10967dec-8f1a-4357-bfc8-988bedb39f90 req-b6c885b0-476c-4468-8a10-d3d751400e0b service nova] Creating event network-changed:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:35:25.150619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-10967dec-8f1a-4357-bfc8-988bedb39f90 req-b6c885b0-476c-4468-8a10-d3d751400e0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101242 Jun 04 09:35:25.152005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 410/810] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:25.629119 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:25.637826 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:25.642271 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:25.643837 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:25.645359 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:25.646811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:25.721255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:25.722358 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:25.730205 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:25.730950 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:25.732037 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:25.732521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:25.990834 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:26.004584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:26.008314 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4b6a36aa-5fc0-4093-9363-173cb1e726d9 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.384166 Jun 04 09:35:26.011860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 401/811] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:25 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:26.014301 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eaced95d-0500-40cd-9936-8183353c215b tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1314 microversion: 2.1 time: 0.299200 Jun 04 09:35:26.024439 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:26.025863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 411/812] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:25 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:26.026499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:26.037916 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:26.038620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:26.039842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:26.040618 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:26.596668 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:26.606036 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fe45748d-89ee-43dd-baa7-9fed044153cd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.592316 Jun 04 09:35:26.606822 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 402/813] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:26 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:27.045047 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:27.046849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:27.048005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:27.053713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:27.065485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:27.075583 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.076442 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.084488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.085285 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.092101 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.094826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.094826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.095709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.383453 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:27.433423 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:27.443866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:27.459215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d5635938-78a8-48b0-b288-ca62cb2e3dee tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.422794 Jun 04 09:35:27.459985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d63c5531-87cf-418a-b698-1d0ca4479a0c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1497 microversion: 2.1 time: 0.429025 Jun 04 09:35:27.461372 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 403/814] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:27 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:27.462483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 412/815] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:27 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1497 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:27.478971 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-9ed3e322-0ca4-442c-8c6d-13335894e1bb req-0a49e0a0-9c0c-40c0-92ff-6c17ec0e6bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bec21a9-1af2-4b98-bf2f-3ae65f98e339", "tag": "fb58f0df-b621-4d35-b33c-86a9fc0be3c9"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:27.496385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9ed3e322-0ca4-442c-8c6d-13335894e1bb req-0a49e0a0-9c0c-40c0-92ff-6c17ec0e6bd5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.497429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9ed3e322-0ca4-442c-8c6d-13335894e1bb req-0a49e0a0-9c0c-40c0-92ff-6c17ec0e6bd5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.522084 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-9ed3e322-0ca4-442c-8c6d-13335894e1bb req-0a49e0a0-9c0c-40c0-92ff-6c17ec0e6bd5 service nova] Creating event network-changed:fb58f0df-b621-4d35-b33c-86a9fc0be3c9 for instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 on hv-cinder-84469 Jun 04 09:35:27.534330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-9ed3e322-0ca4-442c-8c6d-13335894e1bb req-0a49e0a0-9c0c-40c0-92ff-6c17ec0e6bd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056977 Jun 04 09:35:27.534330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 404/816] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:27.625032 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:27.625674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:27.632405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.632852 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.633676 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:27.634110 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:27.754638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=12 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:27.830069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:27.839872 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bda2787f-f106-4a10-8c4d-27c0f426d3d1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.218698 Jun 04 09:35:27.840680 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 413/817] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:27 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:28.482858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:28.484064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:28.493471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:28.494259 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:28.495450 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:28.496195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:28.739832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:28.739832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:28.761193 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:28.762019 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:28.764097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:28.765407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:28.823007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:35:29.032257 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:29.045562 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5d57a43b-c5ad-449d-9c90-2effa22d1268 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.568901 Jun 04 09:35:29.047379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 405/818] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:28 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:29.057311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:29.058851 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:29.068984 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=18 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:29.076797 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:29.084022 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:29.085108 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:29.085763 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:29.313103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1e972844-e563-429c-9348-08ed1a32bf89 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "DELETE /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 204 len: 0 microversion: 2.1 time: 0.581544 Jun 04 09:35:29.315716 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 414/819] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:35:28 2022] DELETE /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:35:29.329490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:29.330433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:29.338884 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:29.339492 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:29.340571 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:29.341077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:29.425472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:29.442783 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-73178319-c578-46e1-b601-1021464bb70f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.392451 Jun 04 09:35:29.444795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 406/820] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:29 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:29.576383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:29.578775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:29.587298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-766f251b-6320-4f49-b084-3dccd95c166c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1503 microversion: 2.1 time: 0.264780 Jun 04 09:35:29.587889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 415/821] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:29 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:30.077090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:30.077929 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:30.092195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.100830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.100830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.100830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.338812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:30.354863 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c84e40a8-d090-4cce-81bb-88ed9485bf11 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.284168 Jun 04 09:35:30.355986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 407/822] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:30 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:30.476166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:30.477464 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:30.492335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.493279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.495227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.496016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.619269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:30.620896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:30.632780 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.633677 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.635312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:30.636156 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:30.667320 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=100 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:30.702399 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:30.717898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3de9fcfc-ab71-4767-8837-6690029cfd2c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.250449 Jun 04 09:35:30.719089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 416/823] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:30 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:31.004094 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:31.014786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4a3f33e8-fa7c-4933-acb4-4630bdda23f4 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1503 microversion: 2.1 time: 0.405192 Jun 04 09:35:31.024725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 408/824] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:30 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:31.384028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:31.386141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:31.406672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.406672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.406672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.406672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.739515 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-d5685266-3cdd-4396-861e-16230f68186f req-16942ae6-cf1a-4a3d-a63b-9a5763a4e785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411bb645-ad60-430f-a941-e6de32757e60", "name": "network-vif-deleted", "tag": "b4046c58-32f3-40fe-896b-4544fe89088c"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:31.758587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d5685266-3cdd-4396-861e-16230f68186f req-16942ae6-cf1a-4a3d-a63b-9a5763a4e785 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.759423 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d5685266-3cdd-4396-861e-16230f68186f req-16942ae6-cf1a-4a3d-a63b-9a5763a4e785 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.774397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:31.784788 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1d840df1-84d3-439a-877e-07549844d28f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.408713 Jun 04 09:35:31.785373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-d5685266-3cdd-4396-861e-16230f68186f req-16942ae6-cf1a-4a3d-a63b-9a5763a4e785 service nova] Creating event network-vif-deleted:b4046c58-32f3-40fe-896b-4544fe89088c for instance 411bb645-ad60-430f-a941-e6de32757e60 on hv-cinder-84469 Jun 04 09:35:31.786963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 417/825] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:31 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:31.796863 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:31.804653 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:31.808253 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-d5685266-3cdd-4396-861e-16230f68186f req-16942ae6-cf1a-4a3d-a63b-9a5763a4e785 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074255 Jun 04 09:35:31.809308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.809501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 409/826] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:35:31.810241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.811631 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.812432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.887954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-31ade6a8-fc43-4e1c-a550-2da49a5ac07a req-c1571724-a69b-4bce-a81f-bc209e04df7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bec21a9-1af2-4b98-bf2f-3ae65f98e339", "name": "network-vif-plugged", "status": "completed", "tag": "fb58f0df-b621-4d35-b33c-86a9fc0be3c9"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:31.914601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-31ade6a8-fc43-4e1c-a550-2da49a5ac07a req-c1571724-a69b-4bce-a81f-bc209e04df7b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:31.924460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-31ade6a8-fc43-4e1c-a550-2da49a5ac07a req-c1571724-a69b-4bce-a81f-bc209e04df7b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:31.932773 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-31ade6a8-fc43-4e1c-a550-2da49a5ac07a req-c1571724-a69b-4bce-a81f-bc209e04df7b service nova] Creating event network-vif-plugged:fb58f0df-b621-4d35-b33c-86a9fc0be3c9 for instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 on hv-cinder-84469 Jun 04 09:35:31.940025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-31ade6a8-fc43-4e1c-a550-2da49a5ac07a req-c1571724-a69b-4bce-a81f-bc209e04df7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066603 Jun 04 09:35:31.941503 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 410/827] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:32.039578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:32.041392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:32.058520 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:32.060545 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:32.063229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:32.066535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:32.107878 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:32.125366 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-12263ad3-a03a-4ef2-8743-a168d2c55c75 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.335677 Jun 04 09:35:32.126902 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 418/828] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:31 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:32.193656 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:32.204142 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-696bc7a6-3e15-4c7b-900c-eb25e6009b68 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1299 microversion: 2.1 time: 0.174074 Jun 04 09:35:32.217221 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 411/829] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:32 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:32.816081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:32.817154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:32.830048 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:32.830866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:32.832373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:32.833140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.148720 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:33.155450 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:33.156180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:33.161684 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f15cf790-765a-47ec-b620-82c8c090dd2b tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.352583 Jun 04 09:35:33.162641 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 419/830] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:32 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:33.164212 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:33.164692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.165492 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:33.165916 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.231740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:33.232945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:33.244618 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:33.245423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.246905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:33.247691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.315232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:33.315999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:33.316932 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lazy-loading 'fault' on Instance uuid 411bb645-ad60-430f-a941-e6de32757e60 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:35:33.421191 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '078a0f5285624b5f82b80e53a3a68ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff077a9afa543b2b239071f9c79ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:33.437362 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a5be42a6-e503-4ab3-93f4-78f9603c3a18 tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 200 len: 1304 microversion: 2.1 time: 0.212660 Jun 04 09:35:33.438744 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 420/831] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:33 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:33.464396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:33.481114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7f7d4e51-f166-4c7b-8b6f-9efa0c695ed6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.329302 Jun 04 09:35:33.482312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 412/832] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:33 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:34.184106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:34.185183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:34.200127 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.201094 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.202228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.202865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.422695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:34.438385 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5f6d409f-daf0-436b-aaae-3695c680f7a6 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1314 microversion: 2.1 time: 0.258482 Jun 04 09:35:34.439429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 421/833] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:34 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:34.467350 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:34.469158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] [instance: 411bb645-ad60-430f-a941-e6de32757e60] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:34.478398 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.479026 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.480110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.481373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.498292 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] HTTP exception thrown: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Request method failure captured: Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 HTTP/1.1 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimycr1dhFjrRC4rEq0eSwyFQ5GePWQZUIkqF2X69mYiUa2T8IJxwQWfJtIZTONMCVDX5n4gTMw5Yt7o5D7iL4Y4GR5KumoYoOC73zSTQf_uu7o6G1QAuGeefh9CMwsz1u2SmchbK1cwvmq43GD3dO4rCzL68jvRfdYVWOxQLVJagTfaU Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: fff077a9afa543b2b239071f9c79ac38 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesActionsTest-485326456 Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:35:34.501182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fff077a9afa543b2b239071f9c79ac38", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fff077a9afa543b2b239071f9c79ac38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesActionsTest-485326456 Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: fff077a9afa543b2b239071f9c79ac38 Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesActionsTest-485326456 Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesActionsTest-485326456-project Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 078a0f5285624b5f82b80e53a3a68ef9 Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesActionsTest-485326456-project Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. Jun 04 09:35:34.503959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '411bb645-ad60-430f-a941-e6de32757e60'} Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:35:34.505765 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. Jun 04 09:35:34.508269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:34.510733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] Returning 404 to user: Instance 411bb645-ad60-430f-a941-e6de32757e60 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:35:34.510733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0bed24ba-f6c5-4971-b8a3-7c6211cc388c tempest-VolumesActionsTest-485326456 tempest-VolumesActionsTest-485326456-project] 10.222.0.46 "GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60" status: 404 len: 111 microversion: 2.1 time: 0.040353 Jun 04 09:35:34.510733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 413/834] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:34 2022] GET /compute/v2.1/servers/411bb645-ad60-430f-a941-e6de32757e60 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:35:34.538249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:34.540475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:34.565020 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.566589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.569433 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:34.570340 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:34.797799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:34.814642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b3db67c7-69bb-4c5d-9041-6ade94c2357c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.286737 Jun 04 09:35:34.832077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 422/835] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:34 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:35.471331 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:35.473631 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:35.494087 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:35.510538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:35.510538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:35.510538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:35.829966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:35.846028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:35.847120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:35.873698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f948eeb6-2de0-4f1c-ab70-1bd2d503434e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1464 microversion: 2.1 time: 0.410790 Jun 04 09:35:35.896637 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 414/836] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:35 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1464 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:35.899330 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:35.900786 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:35.903452 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:35.904380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:35.988806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:35.989629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:36.006708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:36.012443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:36.012443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:36.012443 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:36.070693 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:35:36.224305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:36.246119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b47cf4ed-c0c7-4015-84f4-9c3441da76e4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.407276 Jun 04 09:35:36.248229 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 423/837] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:35 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:36.600806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a83c0a47-807e-4803-8e1c-432c3ecd3c2e tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 204 len: 0 microversion: 2.1 time: 0.618596 Jun 04 09:35:36.604930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 415/838] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:35:35 2022] DELETE /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:35:36.620168 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:36.624234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:36.639674 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:36.643609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:36.646244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:36.647123 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:36.917910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:36.929560 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-40210f50-cfab-4303-8880-d6c8c252df20 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1470 microversion: 2.1 time: 0.316969 Jun 04 09:35:36.930904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 424/839] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:36 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:37.271530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:37.272444 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:37.281865 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:37.282726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:37.283795 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:37.284905 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:37.526037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:37.556057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-43a107b3-2287-4f41-ac1b-da8604cbb8cf tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.292719 Jun 04 09:35:37.558866 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 416/840] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:37 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:37.952999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:37.954267 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:37.969529 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:37.970491 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:37.972642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:37.974028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:38.243087 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:38.259078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c1582ebe-a513-43d9-944e-3f8ac17ec020 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1470 microversion: 2.1 time: 0.313564 Jun 04 09:35:38.260875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 425/841] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:37 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:38.583600 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:38.585004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:38.593968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:38.594438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:38.595334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:38.595859 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:38.808059 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:38.819302 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-706bfc8f-d0e0-4f89-a5fc-3d670a13a7bd tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.240290 Jun 04 09:35:38.826148 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 417/842] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:38 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:39.289629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:39.294979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:39.304912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:39.308422 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:39.309460 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:39.309985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:39.598634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:39.617783 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-eb54f610-7751-4283-8f7b-c2f68f67e858 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1470 microversion: 2.1 time: 0.332247 Jun 04 09:35:39.619909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 426/843] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:39 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:39.845377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:39.846187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:39.857008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:39.858097 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:39.858935 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:39.859389 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:40.218530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:40.248577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1ed1d26e-d87c-45dd-9a97-3edeaf576322 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.407919 Jun 04 09:35:40.251042 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 418/844] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:39 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:40.416671 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-b9e4ddbd-a3f8-4621-9e27-1c9011252586 req-35bfc5f7-f5dd-4598-aaa5-d0449ceab324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "name": "network-vif-plugged", "status": "completed", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:40.427813 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b9e4ddbd-a3f8-4621-9e27-1c9011252586 req-35bfc5f7-f5dd-4598-aaa5-d0449ceab324 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:40.430419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b9e4ddbd-a3f8-4621-9e27-1c9011252586 req-35bfc5f7-f5dd-4598-aaa5-d0449ceab324 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:40.458233 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-b9e4ddbd-a3f8-4621-9e27-1c9011252586 req-35bfc5f7-f5dd-4598-aaa5-d0449ceab324 service nova] Creating event network-vif-plugged:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:35:40.465478 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-b9e4ddbd-a3f8-4621-9e27-1c9011252586 req-35bfc5f7-f5dd-4598-aaa5-d0449ceab324 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055039 Jun 04 09:35:40.467432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 427/845] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:35:40.647274 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:40.652569 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:40.723460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:40.745266 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:40.747065 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:40.750152 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:41.275174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:41.280614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:41.314963 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:41.316411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:41.319392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:41.320818 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:41.433024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:41.468872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fa70c0e8-968c-4f7a-ab7d-84f8cefed072 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1470 microversion: 2.1 time: 0.804468 Jun 04 09:35:41.468872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 419/846] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:40 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1470 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:41.601415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-4a086b4d-5ed6-41e6-a788-fc62f0c248f1 req-4f724dbf-59ab-4c61-9ca6-e89491eea4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bec21a9-1af2-4b98-bf2f-3ae65f98e339", "name": "network-vif-deleted", "tag": "fb58f0df-b621-4d35-b33c-86a9fc0be3c9"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:41.613284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4a086b4d-5ed6-41e6-a788-fc62f0c248f1 req-4f724dbf-59ab-4c61-9ca6-e89491eea4c8 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:41.613790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-4a086b4d-5ed6-41e6-a788-fc62f0c248f1 req-4f724dbf-59ab-4c61-9ca6-e89491eea4c8 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:41.650692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-4a086b4d-5ed6-41e6-a788-fc62f0c248f1 req-4f724dbf-59ab-4c61-9ca6-e89491eea4c8 service nova] Creating event network-vif-deleted:fb58f0df-b621-4d35-b33c-86a9fc0be3c9 for instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 on hv-cinder-84469 Jun 04 09:35:41.667037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-4a086b4d-5ed6-41e6-a788-fc62f0c248f1 req-4f724dbf-59ab-4c61-9ca6-e89491eea4c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067619 Jun 04 09:35:41.668812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 420/847] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 04 09:35:41.785898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:41.818042 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c2267ce1-6409-4b3d-b8e9-768c6b0c2aee tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1260 microversion: 2.1 time: 0.551917 Jun 04 09:35:41.830114 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 428/848] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:41 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1260 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:42.465609 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:42.468343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:42.491869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:42.492666 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:42.494710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:42.495738 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:42.541476 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:42.542213 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:42.542848 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lazy-loading 'fault' on Instance uuid 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:35:42.611522 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:42.622008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5c8f826f-63cc-475d-926a-abc115df7f9f tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1304 microversion: 2.1 time: 0.162355 Jun 04 09:35:42.637742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 421/849] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:42 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:42.840905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:42.843729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:42.887418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:42.890643 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:42.895483 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:42.897158 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.150532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:43.162828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6a4929e8-d390-4290-866f-d63169d03b00 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1444 microversion: 2.1 time: 0.329810 Jun 04 09:35:43.175474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 429/850] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:42 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1444 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:43.182415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:43.184970 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:43.195144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:43.196172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.198374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:43.199075 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.442497 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:43.456369 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0cc5a484-83d4-4f6a-90b8-4e4f65b99b8e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1444 microversion: 2.1 time: 0.278140 Jun 04 09:35:43.466949 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 422/851] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:43 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1444 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:35:43.640603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:43.641252 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:43.651657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:43.656627 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:43.661960 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.664044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:43.671621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.741412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:43.742222 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:43.742903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lazy-loading 'fault' on Instance uuid 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:35:43.837610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f357411d6a547468e94697978f9ca6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe772f995f743118963aa8c85ab5c2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:35:43.849021 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d1b28145-bce3-485a-bf96-13e2915d6755 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 200 len: 1304 microversion: 2.1 time: 0.212423 Jun 04 09:35:43.850686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 430/852] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:43 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:35:44.873189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:35:44.878416 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] [instance: 2bec21a9-1af2-4b98-bf2f-3ae65f98e339] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:35:44.893021 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:35:44.920025 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:44.926977 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:44.931382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:44.936849 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:45.061688 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] HTTP exception thrown: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Request method failure captured: Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 HTTP/1.1 Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimydS4otfV9-nPkOYegx-2Zrjz6ArlPhKfYYjLruwjqH339JYqHq2jjaD-bwTfhJb-trpJ83SS1rwR6jyGHvLeo6-UAmyQV8dt3P5uaHjhqPKpyKKBrgYA3-Z8EqYL-pZzrW3oKeO0dWrF33FsztN7D-iHPL-F1UHUst3AhUGVtch64k Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: ebe772f995f743118963aa8c85ab5c2b Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesNegativeTest-1491468417 Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:35:45.073319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ebe772f995f743118963aa8c85ab5c2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ebe772f995f743118963aa8c85ab5c2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ebe772f995f743118963aa8c85ab5c2b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ebe772f995f743118963aa8c85ab5c2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesNegativeTest-1491468417 Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: ebe772f995f743118963aa8c85ab5c2b Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesNegativeTest-1491468417 Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesNegativeTest-1491468417-project Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 8f357411d6a547468e94697978f9ca6f Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesNegativeTest-1491468417-project Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. Jun 04 09:35:45.077930 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '2bec21a9-1af2-4b98-bf2f-3ae65f98e339'} Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:35:45.079459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. Jun 04 09:35:45.082019 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:35:45.086146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] Returning 404 to user: Instance 2bec21a9-1af2-4b98-bf2f-3ae65f98e339 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:35:45.088665 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cf8ad56a-6000-4f3c-b0a6-d4a0bada7c80 tempest-VolumesNegativeTest-1491468417 tempest-VolumesNegativeTest-1491468417-project] 10.222.0.46 "GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339" status: 404 len: 111 microversion: 2.1 time: 0.222950 Jun 04 09:35:45.112883 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 423/853] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:35:44 2022] GET /compute/v2.1/servers/2bec21a9-1af2-4b98-bf2f-3ae65f98e339 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:35:51.124792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-9f87195f-ba33-4a24-8f9c-6f43eb57a733 req-067d2341-0400-43ac-9f51-5faee328c278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:35:51.152928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9f87195f-ba33-4a24-8f9c-6f43eb57a733 req-067d2341-0400-43ac-9f51-5faee328c278 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:35:51.154243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9f87195f-ba33-4a24-8f9c-6f43eb57a733 req-067d2341-0400-43ac-9f51-5faee328c278 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:35:51.180033 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-9f87195f-ba33-4a24-8f9c-6f43eb57a733 req-067d2341-0400-43ac-9f51-5faee328c278 service nova] Creating event network-changed:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:35:51.186877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-9f87195f-ba33-4a24-8f9c-6f43eb57a733 req-067d2341-0400-43ac-9f51-5faee328c278 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Jun 04 09:35:51.187812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 431/854] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:08.657918 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-831466958", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "networks": [{"uuid": "76bcbf19-06a8-45d0-b67d-27a576d05e8f"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:08.690333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:12.433743 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] validate_networks() for [('76bcbf19-06a8-45d0-b67d-27a576d05e8f', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:36:13.108157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:36:13.109833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:36:13.110655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:36:13.111606 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:36:13.112387 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:36:13.136073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:13.136886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:13.138777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:13.139593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:13.179189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Getting quotas for project 77242525fe2f49c6b38755c270885b79. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:36:13.186521 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Getting quotas for user 611fcce3edba4ce68c50d96736c7b853 and project 77242525fe2f49c6b38755c270885b79. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:36:13.216526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:36:13.221551 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:36:13.400095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8e0c4317-7a67-4cc2-a0fd-81540042df25 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.759072 Jun 04 09:36:13.403103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 424/855] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:36:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:36:13.418623 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2d39c3e5-cad2-4585-9f5c-49be39c11a55 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:13.423420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2d39c3e5-cad2-4585-9f5c-49be39c11a55 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:13.446384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=93 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:13.447917 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=5 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:13.605772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2d39c3e5-cad2-4585-9f5c-49be39c11a55 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:13.617793 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2d39c3e5-cad2-4585-9f5c-49be39c11a55 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1218 microversion: 2.1 time: 0.208256 Jun 04 09:36:13.619300 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 432/856] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:13 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:14.644333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ad037ab4-0cca-4917-89e9-49961d575c29 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:14.645419 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ad037ab4-0cca-4917-89e9-49961d575c29 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:14.926171 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ad037ab4-0cca-4917-89e9-49961d575c29 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:14.943632 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ad037ab4-0cca-4917-89e9-49961d575c29 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1218 microversion: 2.1 time: 0.306588 Jun 04 09:36:14.956323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 425/857] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:14 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:15.974624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09c5c5ff-a756-44a6-a596-4956e6c480f0 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:15.975263 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09c5c5ff-a756-44a6-a596-4956e6c480f0 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:16.100661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09c5c5ff-a756-44a6-a596-4956e6c480f0 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:16.108542 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09c5c5ff-a756-44a6-a596-4956e6c480f0 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1218 microversion: 2.1 time: 0.138756 Jun 04 09:36:16.109347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 433/858] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:15 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:16.330276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d9f2e04b-4721-4a97-a35f-7e75ff54ee47 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'create', calling method: .version_select at 0x7fa415ce4940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-897396718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3fwoYWcFZ7YanRv1ggIjVQZsjGwsJYozuo4l90O6dnEXiHrTuFdNhE7qZnilKNuM1KFupM+MvZsCWBg1evckOHHGETU2KSzAzmJKW/3zpUgdAUpLMiI4qAUz3QrkVWwg=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:16.347424 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d9f2e04b-4721-4a97-a35f-7e75ff54ee47 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Getting quotas for project a3e40664a37c420c9fc2e05af20e182b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:36:16.352595 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d9f2e04b-4721-4a97-a35f-7e75ff54ee47 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Getting quotas for user 0d44567701db44e3802d73705c899dd4 and project a3e40664a37c420c9fc2e05af20e182b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:36:16.486557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d9f2e04b-4721-4a97-a35f-7e75ff54ee47 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.160575 Jun 04 09:36:16.487250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 426/859] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:36:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:16.609774 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1781069624", "imageRef": "91673af4-49f4-4635-ae55-c757a0da31ad", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-897396718", "networks": [{"uuid": "0b66f292-20aa-47ea-a6fc-a91f7e2fb578"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:16.674895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] validate_networks() for [('0b66f292-20aa-47ea-a6fc-a91f7e2fb578', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:36:17.129876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:17.130903 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:17.140753 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:17.141460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:17.142833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:17.143421 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:17.213859 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:36:17.214656 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:36:17.215231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:36:17.216055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:36:17.216651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:36:17.232430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:17.242411 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:17.242867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:17.242867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:17.242867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:17.248070 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-23fe6661-5fc6-49c8-8830-dfb0ce4d881c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1214 microversion: 2.1 time: 0.124585 Jun 04 09:36:17.249939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 427/860] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:17 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:17.262925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Getting quotas for project a3e40664a37c420c9fc2e05af20e182b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:36:17.268656 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Getting quotas for user 0d44567701db44e3802d73705c899dd4 and project a3e40664a37c420c9fc2e05af20e182b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:36:17.283523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:36:17.288388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91673af4-49f4-4635-ae55-c757a0da31ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:36:17.455546 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-192d64a8-9d14-48fa-9b3c-24206c80452d tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849566 Jun 04 09:36:17.456835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 434/861] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:36:17.472338 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-08af2ce8-ea04-4f6d-a3f0-b93b591c59ce tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:17.473291 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-08af2ce8-ea04-4f6d-a3f0-b93b591c59ce tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:17.558176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-08af2ce8-ea04-4f6d-a3f0-b93b591c59ce tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:17.567395 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-08af2ce8-ea04-4f6d-a3f0-b93b591c59ce tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1258 microversion: 2.1 time: 0.100737 Jun 04 09:36:17.568172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 428/862] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:17 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:18.273040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:18.274148 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:18.285866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:18.287724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:18.289308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:18.290068 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:18.468835 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:18.480776 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c66e832b-a407-48dd-9674-c0c9c920ec5a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1278 microversion: 2.1 time: 0.216893 Jun 04 09:36:18.481823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 435/863] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:18 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:18.592585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-05b1dbde-ddeb-4239-8b78-d77ce8f8e426 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:18.599153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-05b1dbde-ddeb-4239-8b78-d77ce8f8e426 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:18.678445 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-05b1dbde-ddeb-4239-8b78-d77ce8f8e426 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:18.693999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-05b1dbde-ddeb-4239-8b78-d77ce8f8e426 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1258 microversion: 2.1 time: 0.111303 Jun 04 09:36:18.695299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 429/864] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:18 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1258 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:19.506246 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:19.507392 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:19.520922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:19.521670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:19.523120 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:19.524329 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:19.718802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:19.719943 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:19.734453 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:19.735319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:19.738416 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:19.739429 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:19.889347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:19.905616 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5dcc3b90-5a8c-43c1-9461-fe6528b2532a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1254 microversion: 2.1 time: 0.194767 Jun 04 09:36:19.907441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 430/865] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:19 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1254 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:19.961457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:19.975246 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-48252156-798f-4861-8845-92f4cea5ce37 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.476675 Jun 04 09:36:19.976642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 436/866] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:19 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:20.926708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:20.927911 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:20.939431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:20.940586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:20.942024 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:20.942913 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:21.003016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:21.004499 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:21.025327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:21.026628 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:21.027989 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:21.029166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:21.109655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:21.122768 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-392d28d9-4c45-44d3-8291-73831b32e6e2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1318 microversion: 2.1 time: 0.203056 Jun 04 09:36:21.123597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 431/867] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:20 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:21.773234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:21.782234 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-bde7020a-632c-423c-b929-ad86364370ae tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.784715 Jun 04 09:36:21.782991 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 437/868] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:20 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:22.020230 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-639c2a92-38fb-41a4-9592-89fc02a41ee9 req-4777359a-9612-418f-99ff-86e76d6f48f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b490fe06-8fb0-4875-8f9b-baa5fa0de039", "tag": "95085789-dfe9-4096-b475-dac51df8c31e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:22.041939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-639c2a92-38fb-41a4-9592-89fc02a41ee9 req-4777359a-9612-418f-99ff-86e76d6f48f7 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:22.042844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-639c2a92-38fb-41a4-9592-89fc02a41ee9 req-4777359a-9612-418f-99ff-86e76d6f48f7 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:22.073752 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-639c2a92-38fb-41a4-9592-89fc02a41ee9 req-4777359a-9612-418f-99ff-86e76d6f48f7 service nova] Creating event network-changed:95085789-dfe9-4096-b475-dac51df8c31e for instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 on hv-cinder-84469 Jun 04 09:36:22.089755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-639c2a92-38fb-41a4-9592-89fc02a41ee9 req-4777359a-9612-418f-99ff-86e76d6f48f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076704 Jun 04 09:36:22.091649 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 432/869] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:22.150418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:22.152000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:22.167180 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:22.167780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:22.169101 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:22.172726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:22.434932 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:22.455461 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a428e8cc-3b7e-426a-bee8-de1eafd03006 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1316 microversion: 2.1 time: 0.312696 Jun 04 09:36:22.457579 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 438/870] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:22 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:22.806376 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:22.807527 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:22.838485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:22.850177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:22.854468 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:22.859382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:23.156754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:23.305526 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:23.316611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8cc33523-1d4e-4311-9381-5aa215dc5bd4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.514502 Jun 04 09:36:23.318477 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 433/871] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:22 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:23.478768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:23.479430 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:23.502095 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:23.503383 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:23.506425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:23.507895 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:23.884981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:23.898733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-709a29e0-4baf-4713-8fb2-885800161765 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.425767 Jun 04 09:36:23.899748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 439/872] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:23 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:24.339243 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:24.339886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:24.347879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:24.348406 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:24.349258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:24.349626 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:24.758034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:24.793737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2df5e602-c81a-4e41-947c-e7eaa091b6b6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.455255 Jun 04 09:36:24.797541 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 434/873] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:24 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:24.926008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:24.926734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:24.938213 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:24.938976 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:24.940397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:24.941149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:25.317091 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:25.326686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d9929fcf-489c-48a0-90a7-3a5041b38b5a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.405943 Jun 04 09:36:25.327507 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 440/874] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:24 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:25.570194 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-72ea43f6-9817-4a22-9218-946efba8b806 req-6603bcb7-beaf-4e58-8692-fe04d8762a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:25.582676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-72ea43f6-9817-4a22-9218-946efba8b806 req-6603bcb7-beaf-4e58-8692-fe04d8762a9e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:25.583311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-72ea43f6-9817-4a22-9218-946efba8b806 req-6603bcb7-beaf-4e58-8692-fe04d8762a9e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:25.608483 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-72ea43f6-9817-4a22-9218-946efba8b806 req-6603bcb7-beaf-4e58-8692-fe04d8762a9e service nova] Creating event network-changed:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:36:25.618023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-72ea43f6-9817-4a22-9218-946efba8b806 req-6603bcb7-beaf-4e58-8692-fe04d8762a9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062577 Jun 04 09:36:25.619204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 435/875] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:25.824894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:25.825832 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:25.833575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:25.834025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:25.834810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:25.845089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:26.183780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:26.195008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a9d12656-9d7b-4ad0-8d8a-47e70160cd08 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.374225 Jun 04 09:36:26.204619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 441/876] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:25 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:26.353508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:26.354806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:26.367538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:26.374733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:26.374733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:26.374733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:26.614646 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:26.631046 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-168078ae-29df-4845-b4b0-efaaca766bc1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.285922 Jun 04 09:36:26.632839 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 436/877] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:26 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:27.220059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:27.222451 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:27.233041 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:27.234402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:27.236629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:27.240250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:27.256444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:27.306969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=10 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:27.595229 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:27.605495 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-aa652ba6-e1d2-4fed-9198-652da5f33114 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.395821 Jun 04 09:36:27.606703 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 442/878] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:27 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:27.657396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:27.661158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:27.672694 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:27.673451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:27.674819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:27.675788 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:27.933965 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:27.962448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7b8b5ba7-5e0b-406d-948e-6fbb384a5375 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.313503 Jun 04 09:36:27.966069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 437/879] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:27 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:28.631107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:28.632640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:28.655008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:28.655800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:28.657230 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:28.658354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:28.988469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=16 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:28.993858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:28.994906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:29.007488 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:29.010347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:29.014611 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:29.015391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:29.129076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:29.140176 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-16bf37a3-4c0a-4988-9fd4-b86d549b5f95 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.513916 Jun 04 09:36:29.164322 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 443/880] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:28 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:29.475129 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:29.499741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-343fa72f-2524-432a-86d4-c863ed9fea07 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.513704 Jun 04 09:36:29.506999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 438/881] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:28 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:30.184418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:30.189577 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:30.210419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:30.210419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:30.210419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:30.210419 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:30.440756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:30.476733 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e6007098-9884-459c-969b-85a1bb8a49a1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.298508 Jun 04 09:36:30.479636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 444/882] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:30 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:30.544144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:30.545494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:30.559709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:30.562748 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:30.562748 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:30.563818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:30.606740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-10227cea-7d34-4653-a6f6-e76d4900c819 req-84408301-1903-4e42-8640-b19cfecf868b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b490fe06-8fb0-4875-8f9b-baa5fa0de039", "name": "network-vif-plugged", "status": "completed", "tag": "95085789-dfe9-4096-b475-dac51df8c31e"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:30.651948 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-10227cea-7d34-4653-a6f6-e76d4900c819 req-84408301-1903-4e42-8640-b19cfecf868b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:30.656555 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-10227cea-7d34-4653-a6f6-e76d4900c819 req-84408301-1903-4e42-8640-b19cfecf868b service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:30.689724 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-10227cea-7d34-4653-a6f6-e76d4900c819 req-84408301-1903-4e42-8640-b19cfecf868b service nova] Creating event network-vif-plugged:95085789-dfe9-4096-b475-dac51df8c31e for instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 on hv-cinder-84469 Jun 04 09:36:30.710053 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-10227cea-7d34-4653-a6f6-e76d4900c819 req-84408301-1903-4e42-8640-b19cfecf868b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112196 Jun 04 09:36:30.711749 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 445/883] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:30.893287 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:30.904241 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f91a37e-661d-439e-9d02-f308231b78b9 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.367570 Jun 04 09:36:30.905039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 439/884] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:30 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:31.508331 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:31.509805 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:31.518178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:31.518969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:31.520087 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:31.520678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:31.822160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:31.838372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c5bc6f1d-be08-4acb-a373-d34fab640e96 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.339388 Jun 04 09:36:31.850877 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 446/885] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:31 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:31.928909 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:31.931100 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:31.943252 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:31.944578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:31.946255 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:31.947277 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:32.177498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:32.186039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9c525575-ca76-4251-b6dc-51f16c3b07b2 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.264374 Jun 04 09:36:32.186644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 440/886] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:31 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:32.876214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:32.876214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:32.876214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:32.876214 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:32.877348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:32.877348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:33.059096 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:33.066799 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-05f1254b-604b-49da-ac9f-8ed6859e6bbd tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.212540 Jun 04 09:36:33.067544 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 447/887] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:32 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:33.205900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:33.213629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:33.213629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:33.213629 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:33.214149 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:33.214587 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:33.371048 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:33.380180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6472ec64-2869-409b-83a4-a2d56c748303 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.178715 Jun 04 09:36:33.380818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 441/888] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:33 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:34.084871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:34.086374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:34.093548 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:34.094472 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:34.095485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:34.096751 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:34.253354 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:34.268541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ebbebd73-a58e-4eb1-a71b-9213067a29e7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1318 microversion: 2.1 time: 0.188474 Jun 04 09:36:34.272420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 448/889] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:34 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:34.407840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:34.409183 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:34.422563 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:34.423330 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:34.425385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:34.426449 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:34.609127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:34.624323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-51338959-e694-472e-9b7d-d84946f2e93c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.224919 Jun 04 09:36:34.625228 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 442/890] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:34 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:36:35.286713 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:35.287320 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:35.294357 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:35.294806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:35.295593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:35.296020 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:35.443849 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:35.454166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-240f76b4-7a65-4379-b0a5-39356acb7a1a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1507 microversion: 2.1 time: 0.172115 Jun 04 09:36:35.454764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 449/891] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:35 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:35.642825 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:35.644216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:35.651656 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:35.652115 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:35.652938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:35.653736 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:35.798636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:36:35.798910 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:36:35.834531 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:35.843910 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-921bb7fa-8fee-4d2f-941b-93bcc1d5fedf tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.205006 Jun 04 09:36:35.844536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 443/892] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:35 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:36.382396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-b3450591-85c5-47a3-89b0-fc9914fafef6 req-8081c3a1-2363-4bed-848a-9c3c423bb1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "name": "network-vif-plugged", "status": "completed", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:36.392696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b3450591-85c5-47a3-89b0-fc9914fafef6 req-8081c3a1-2363-4bed-848a-9c3c423bb1a5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:36.392696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-b3450591-85c5-47a3-89b0-fc9914fafef6 req-8081c3a1-2363-4bed-848a-9c3c423bb1a5 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:36.405614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-b3450591-85c5-47a3-89b0-fc9914fafef6 req-8081c3a1-2363-4bed-848a-9c3c423bb1a5 service nova] Creating event network-vif-plugged:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:36:36.411752 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-b3450591-85c5-47a3-89b0-fc9914fafef6 req-8081c3a1-2363-4bed-848a-9c3c423bb1a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Jun 04 09:36:36.417339 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 450/893] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:36.861558 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:36.862742 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:36.870360 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:36.870829 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:36.871636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:36.872090 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:37.076610 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:37.086030 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c7a5919b-7c65-4aec-852a-487219c372dd tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.228418 Jun 04 09:36:37.086628 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 444/894] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:36 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:38.104414 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:38.105132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:38.112986 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:38.113842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:38.115170 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:38.115777 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:38.272710 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:38.301798 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f752f3cf-13d7-4ca7-90c2-26f6f3cc7c79 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1358 microversion: 2.1 time: 0.198145 Jun 04 09:36:38.302685 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 451/895] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:38 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:39.323166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:39.323958 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:39.326039 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:39.333076 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.333755 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:39.334927 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.335604 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:39.341867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=91 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:39.542188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:39.556921 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5fc9e237-4a25-4e31-883d-b0b81aa5b13b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1549 microversion: 2.1 time: 0.238069 Jun 04 09:36:39.558385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:39 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1549 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:39.587636 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:39.588817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:39.602702 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.603707 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:39.605562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.606787 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:39.649521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:39.827327 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:39.846178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8ca91c37-694d-4b52-8b3c-bec1c88eba1f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1549 microversion: 2.1 time: 0.264617 Jun 04 09:36:39.847338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 452/897] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:39 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1549 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:39.870684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:39.878011 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:39.879437 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Searching by: {'deleted': False, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b'} {{(pid=118476) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 09:36:39.890604 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.891228 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:39.892276 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:39.893157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:40.070107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.multi_cell_list [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118476) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 09:36:40.250232 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8cb0bb8b-3f9d-496b-b77c-5da83e8fde7f tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.387464 Jun 04 09:36:40.250830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 446/898] 10.222.0.46 () {58 vars in 1124 bytes} [Sat Jun 4 09:36:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:40.268762 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:40.270651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:40.281767 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:40.282560 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:40.284171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:40.285081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:40.495772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:40.507840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f55877b8-59ed-401e-8380-9b5cfebb86e8 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1549 microversion: 2.1 time: 0.246217 Jun 04 09:36:40.508731 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 453/899] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:40 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1549 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:42.982702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3214b5e3-3600-412e-b7a9-aac97302d98e"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:42.984707 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:42.997014 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:42.997503 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:42.998910 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:42.999540 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:44.048153 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9ccb6b25-7814-4980-b01e-e7321cdd373c tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.072845 Jun 04 09:36:44.049534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 447/900] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:36:42 2022] POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments => generated 194 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:52.663726 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0914f088-e814-46b0-bd04-a977616e03a9", "device": "/dev/sdb"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:52.665670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:52.669053 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:52.669807 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=8 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:52.675166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:52.675624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:52.676424 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:52.676871 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:52.835994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:36:52.842508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:36:52.843342 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:36:52.855617 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:52.856456 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:52.857812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:52.858595 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:53.010813 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:36:53.019983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5ad56162-ace5-47fd-8642-7aabda75cbbe tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1595 microversion: 2.1 time: 0.186509 Jun 04 09:36:53.020626 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 448/901] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:36:52 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1595 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:36:53.583790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-08e400c5-ec40-4217-a316-f08df32cd383 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "POST /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924430 Jun 04 09:36:53.584583 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 454/902] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:36:52 2022] POST /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:36:55.839312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-0bd160bf-659f-470b-bdef-20b5a66fee95 req-419e8883-1d18-4af9-b4e8-9572df70e67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:36:55.849698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-0bd160bf-659f-470b-bdef-20b5a66fee95 req-419e8883-1d18-4af9-b4e8-9572df70e67f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:36:55.850270 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-0bd160bf-659f-470b-bdef-20b5a66fee95 req-419e8883-1d18-4af9-b4e8-9572df70e67f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:36:55.863615 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-0bd160bf-659f-470b-bdef-20b5a66fee95 req-419e8883-1d18-4af9-b4e8-9572df70e67f service nova] Creating event network-changed:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:36:55.869620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-0bd160bf-659f-470b-bdef-20b5a66fee95 req-419e8883-1d18-4af9-b4e8-9572df70e67f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033909 Jun 04 09:36:55.871007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 449/903] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:37:00.310236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-921571042"}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:00.311352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:00.323163 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:00.324034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:00.325402 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:00.326241 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:00.508979 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.network.security_group_api [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Adding security group b75cbef9-bf9a-4a9b-a751-a08ff25e4be6 to port 57fc7a38-0352-4ed2-86c0-8326320ec471 Jun 04 09:37:01.036611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f9be30ba-465f-4332-a544-629b53c0c2cc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action" status: 202 len: 0 microversion: 2.1 time: 0.734761 Jun 04 09:37:01.041990 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 455/904] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:37:00 2022] POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:37:01.055155 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:01.056548 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:01.085867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:01.088135 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:01.090474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:01.094084 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:01.228896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-1c7fdb1e-7e16-444b-b7e3-dc0914e7708e req-d8521670-0dc9-4bf0-bd4b-b3e730f8869e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:01.238923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1c7fdb1e-7e16-444b-b7e3-dc0914e7708e req-d8521670-0dc9-4bf0-bd4b-b3e730f8869e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:01.239650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1c7fdb1e-7e16-444b-b7e3-dc0914e7708e req-d8521670-0dc9-4bf0-bd4b-b3e730f8869e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:01.279434 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-1c7fdb1e-7e16-444b-b7e3-dc0914e7708e req-d8521670-0dc9-4bf0-bd4b-b3e730f8869e service nova] Creating event network-changed:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:37:01.297806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-1c7fdb1e-7e16-444b-b7e3-dc0914e7708e req-d8521670-0dc9-4bf0-bd4b-b3e730f8869e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254787 Jun 04 09:37:01.300710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 450/905] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:37:01.522900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:01.547929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2c63337d-e667-418e-b2a2-a4a2cd5ecb05 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1760 microversion: 2.1 time: 0.500384 Jun 04 09:37:01.547929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 456/906] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:01 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1760 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:19.918096 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:19.918964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:19.922414 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=11 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:19.923135 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:19.927391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:19.931204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:19.931204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:19.931204 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:20.029858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lazy-loading 'services' on Instance uuid b490fe06-8fb0-4875-8f9b-baa5fa0de039 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:37:20.267323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-54421cd4-4424-497c-8244-7a69c84c9da5 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039/os-volume_attachments/0914f088-e814-46b0-bd04-a977616e03a9" status: 202 len: 0 microversion: 2.1 time: 0.353261 Jun 04 09:37:20.268135 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 451/907] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:37:19 2022] DELETE /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039/os-volume_attachments/0914f088-e814-46b0-bd04-a977616e03a9 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:37:22.471986 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:22.472626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:22.475150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:22.475839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:22.481580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:22.486681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:22.486681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:22.486681 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:22.512212 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:37:22.906444 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a727b9b5-c84c-4e5f-9dfc-8f8f26cb38b1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 204 len: 0 microversion: 2.1 time: 0.438365 Jun 04 09:37:22.907207 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 457/908] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:37:22 2022] DELETE /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:37:22.917437 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:22.918151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:22.924981 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:22.925446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:22.926282 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:22.926723 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:23.097752 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:23.106461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-82d4876b-e2d8-4ce2-8fd0-ace92c899d3a tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1513 microversion: 2.1 time: 0.193790 Jun 04 09:37:23.107053 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 452/909] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:22 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:24.126038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:24.126717 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:24.133730 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.134183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.134981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.135422 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.218340 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:24.219467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:24.227507 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.227962 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.228881 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.229323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.286687 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:24.302513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5dcfd7e7-b461-477a-aa12-afbec42fa4b3 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1513 microversion: 2.1 time: 0.180406 Jun 04 09:37:24.303590 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 458/910] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:24 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:24.493726 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e21a404a-bcc9-4fb7-9a1e-ede26431590b tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action" status: 202 len: 0 microversion: 2.1 time: 0.279412 Jun 04 09:37:24.494383 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 453/911] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:37:24 2022] POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:37:24.502992 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:24.503604 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:24.509951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.510390 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.511164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:24.511595 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:24.675450 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:24.688010 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-44b9d0da-5cdc-4c9c-9979-5c798b7b2118 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1752 microversion: 2.1 time: 0.188651 Jun 04 09:37:24.688816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 459/912] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:24 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:25.322680 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:25.323469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:25.332532 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:25.333191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:25.334324 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:25.334900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:25.624568 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:25.634238 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-346a3d13-b4e3-405b-811e-5a47ade0c323 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1513 microversion: 2.1 time: 0.316899 Jun 04 09:37:25.635171 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 454/913] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:25 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:25.710829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:25.711624 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:25.719755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:25.720946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:25.721810 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:25.722589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:25.843802 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-5a2dc2a6-66c2-4736-8637-adddc0f8dab4 req-155e6b75-9125-4f3f-b0dc-29c8665d51f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b490fe06-8fb0-4875-8f9b-baa5fa0de039", "name": "network-vif-deleted", "tag": "95085789-dfe9-4096-b475-dac51df8c31e"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:25.853416 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-5a2dc2a6-66c2-4736-8637-adddc0f8dab4 req-155e6b75-9125-4f3f-b0dc-29c8665d51f0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:25.854275 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-5a2dc2a6-66c2-4736-8637-adddc0f8dab4 req-155e6b75-9125-4f3f-b0dc-29c8665d51f0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:25.874141 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-5a2dc2a6-66c2-4736-8637-adddc0f8dab4 req-155e6b75-9125-4f3f-b0dc-29c8665d51f0 service nova] Creating event network-vif-deleted:95085789-dfe9-4096-b475-dac51df8c31e for instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 on hv-cinder-84469 Jun 04 09:37:25.880446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-5a2dc2a6-66c2-4736-8637-adddc0f8dab4 req-155e6b75-9125-4f3f-b0dc-29c8665d51f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042784 Jun 04 09:37:25.883365 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 455/914] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:37:25.979690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:25.991411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2b4fb30d-f054-48b9-a01c-9d898ed729dc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1752 microversion: 2.1 time: 0.286877 Jun 04 09:37:25.992820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 460/915] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:25 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1752 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:26.660530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:26.662083 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:26.670234 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:26.670701 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:26.671504 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:26.671945 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:26.707051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:26.707560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:26.708070 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lazy-loading 'fault' on Instance uuid b490fe06-8fb0-4875-8f9b-baa5fa0de039 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:37:26.761667 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:26.771417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-32bfd655-878c-42b5-9788-4787ab6c625c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 200 len: 1308 microversion: 2.1 time: 0.115735 Jun 04 09:37:26.772081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 456/916] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:26 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:27.015237 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:27.015911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:27.024018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:27.024504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:27.025305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:27.025748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:27.212725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:27.223691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ed153649-8be3-4f99-a8a5-aa3026c7de34 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.212419 Jun 04 09:37:27.224398 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 461/917] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:27 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:27.790077 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:27.791126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: b490fe06-8fb0-4875-8f9b-baa5fa0de039] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:27.798733 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:27.799179 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:27.799986 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:27.800550 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:27.815757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] HTTP exception thrown: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Request method failure captured: Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 HTTP/1.1 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyeFeR_n5JB7HOezDWrcQQtJOpjJHzYPSRgF_AuBv0fqmz0jJcKo9U241AwQ61VHfr5gazVgDfGfvBLu6shq3B_tSbR7S6G9Ls2PI63a7LSRCHIlIi64ZEEGb-Pdukzds6Oq2US-oUUZFHO7Vgf6BWmsHYmW37Tb7yKsIyzqY1RIOkM Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 77242525fe2f49c6b38755c270885b79 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:37:27.817642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77242525fe2f49c6b38755c270885b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77242525fe2f49c6b38755c270885b79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_77242525fe2f49c6b38755c270885b79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/77242525fe2f49c6b38755c270885b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 77242525fe2f49c6b38755c270885b79 Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesSnapshotTestJSON-2112966208-project Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 611fcce3edba4ce68c50d96736c7b853 Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112966208-project Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. Jun 04 09:37:27.820710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': 'b490fe06-8fb0-4875-8f9b-baa5fa0de039'} Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:37:27.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. Jun 04 09:37:27.827493 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:37:27.828891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Returning 404 to user: Instance b490fe06-8fb0-4875-8f9b-baa5fa0de039 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:37:27.828891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d8531080-9c33-4017-9dfe-035f00edf082 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039" status: 404 len: 111 microversion: 2.1 time: 0.033818 Jun 04 09:37:27.828891 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 457/918] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:27 2022] GET /compute/v2.1/servers/b490fe06-8fb0-4875-8f9b-baa5fa0de039 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:37:28.246394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:28.247513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:28.260341 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:28.261355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:28.264005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:28.265299 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:28.464951 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:28.475069 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-5e99cb09-8033-4c0a-afe8-7e6ffa8f5946 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.235675 Jun 04 09:37:28.475817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 462/919] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:28 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:29.494512 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:29.495167 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:29.502931 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:29.503385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:29.504199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:29.504672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:29.755196 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:29.764413 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-debffc57-e91e-4cea-a5de-0e62a0377d44 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.273826 Jun 04 09:37:29.765005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 458/920] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:29 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:30.787375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:30.788535 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:30.799698 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:30.800477 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:30.801537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:30.802207 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:30.975675 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:30.991748 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-46d1d85b-f0b8-4b69-803f-849f4b631dae tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.211707 Jun 04 09:37:30.992953 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 463/921] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:30 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:32.011519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:32.012151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:32.020169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:32.020649 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:32.021459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:32.021899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:32.190899 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:32.206495 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d1d85e91-a265-4f29-be90-a3b19606d6c1 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.198631 Jun 04 09:37:32.207751 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 459/922] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:32 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:33.226599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:33.227608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:33.235379 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:33.235881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:33.236892 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:33.237380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:33.409213 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:33.417870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-63d49805-b7ad-461e-a178-800040df76aa tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.195830 Jun 04 09:37:33.418470 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 464/923] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:33 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:34.435446 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:34.436154 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:34.443406 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:34.443860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:34.444708 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:34.445152 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:34.606924 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:34.619354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4865ec3-ebd1-4673-a097-4480ebbeafdc tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.187546 Jun 04 09:37:34.620530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 460/924] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:34 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:35.643699 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:35.644597 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:35.651756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:35.652230 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:35.653104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:35.653550 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:35.820735 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:35.830391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-8d9afa6f-dcb7-418e-bfb3-7cdab25c1849 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.191367 Jun 04 09:37:35.830981 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 465/925] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:35 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:36.466701 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-994910462", "imageRef": "548f2957-531c-45bb-bd73-d82bb1d243f4", "flavorRef": "452", "networks": [{"uuid": "76bcbf19-06a8-45d0-b67d-27a576d05e8f"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:36.530528 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] validate_networks() for [('76bcbf19-06a8-45d0-b67d-27a576d05e8f', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:37:36.850328 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:36.851685 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:36.859449 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:36.860082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:36.861712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:36.862360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:37.119771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:37.125735 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:37:37.130808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:37:37.130808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:37:37.130808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:37:37.131186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e481bb8b-8167-4c2a-96c2-a917eb8562e4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1757 microversion: 2.1 time: 0.283512 Jun 04 09:37:37.131323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:37:37.131555 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 466/926] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:36 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1757 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:37.147252 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:37.148011 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:37.149885 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:37.150686 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:37.179522 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Getting quotas for project 77242525fe2f49c6b38755c270885b79. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:37:37.187820 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Getting quotas for user 611fcce3edba4ce68c50d96736c7b853 and project 77242525fe2f49c6b38755c270885b79. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:37:37.210156 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:37:37.214607 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='548f2957-531c-45bb-bd73-d82bb1d243f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:37:37.400273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f3a24282-01c5-4d52-8578-08f786144d24 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940068 Jun 04 09:37:37.401008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 461/927] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:37:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:37:37.416361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c0d048d5-3f11-4f5e-b5e1-4649106ba6d7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:37.417727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c0d048d5-3f11-4f5e-b5e1-4649106ba6d7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:37.500226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c0d048d5-3f11-4f5e-b5e1-4649106ba6d7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:37.510677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c0d048d5-3f11-4f5e-b5e1-4649106ba6d7 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1218 microversion: 2.1 time: 0.101585 Jun 04 09:37:37.519400 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 467/928] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:37 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:38.148473 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:38.149158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:38.156390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:38.165776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:38.165776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:38.165776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:38.348793 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:38.357917 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1a6ec615-58ea-4954-a110-630fbdfe2342 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1760 microversion: 2.1 time: 0.214549 Jun 04 09:37:38.358504 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 462/929] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:38 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1760 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:38.544247 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b3e74a09-a6c9-436f-9222-faba774ae9b9 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:38.545164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b3e74a09-a6c9-436f-9222-faba774ae9b9 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:38.603056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b3e74a09-a6c9-436f-9222-faba774ae9b9 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:38.612494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b3e74a09-a6c9-436f-9222-faba774ae9b9 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1218 microversion: 2.1 time: 0.072388 Jun 04 09:37:38.613102 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 468/930] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:38 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:39.632690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:39.633777 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:39.644999 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:39.645775 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:39.647165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:39.647876 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:39.727326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:39.736073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4b5fdc09-7f77-4322-93ef-61f176a20fa6 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1270 microversion: 2.1 time: 0.109389 Jun 04 09:37:39.736995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 463/931] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:39 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:40.060166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:40.061280 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:40.069122 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.069661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.070619 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.071176 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.106691 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lazy-loading 'flavor' on Instance uuid 3929ccb4-c14c-4301-bac7-cae49a726de5 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:37:40.458198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-636a42f3-ac85-4403-b408-2c3951f7d77b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "POST /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5/action" status: 202 len: 0 microversion: 2.1 time: 0.402446 Jun 04 09:37:40.459103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 469/932] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:37:40 2022] POST /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:37:40.469283 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:40.470083 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:40.479690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.481055 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.482078 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.482628 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.755826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:40.757074 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:40.765558 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.769210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.769210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:40.769210 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:40.917901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:40.931298 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4f500509-e931-4763-ab7c-22cb770d0605 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1276 microversion: 2.1 time: 0.180483 Jun 04 09:37:40.932387 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 470/933] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:40 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:41.020511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:41.034535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ef36514b-5484-4110-8761-2592a63fbf6a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.569587 Jun 04 09:37:41.035720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 464/934] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:40 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:41.953907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:41.955145 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:41.967041 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:41.967829 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:41.968984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:41.969760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:42.066118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:42.067288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:42.075038 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:42.075498 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:42.076427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:42.076786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:42.295152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:42.301787 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:42.307460 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d8484216-ec85-418c-8851-3b2dc9228258 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.360907 Jun 04 09:37:42.308308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 471/935] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:41 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:42.377441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:42.390214 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b4273516-ea27-4296-855e-088789f2215a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.328045 Jun 04 09:37:42.391288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 465/936] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:42 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:42.647044 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-9597567e-8c22-4a2e-bab9-7fd5344fccaf req-8feb9646-7be4-46b9-bfd7-f0e99cc019f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b60e3c6-dd02-4f36-94a2-905721262257", "tag": "ecbeca6b-ff36-477c-ab4c-040ddc298883"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:42.665116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9597567e-8c22-4a2e-bab9-7fd5344fccaf req-8feb9646-7be4-46b9-bfd7-f0e99cc019f1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:42.666894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-9597567e-8c22-4a2e-bab9-7fd5344fccaf req-8feb9646-7be4-46b9-bfd7-f0e99cc019f1 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:42.692458 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-9597567e-8c22-4a2e-bab9-7fd5344fccaf req-8feb9646-7be4-46b9-bfd7-f0e99cc019f1 service nova] Creating event network-changed:ecbeca6b-ff36-477c-ab4c-040ddc298883 for instance 0b60e3c6-dd02-4f36-94a2-905721262257 on hv-cinder-84469 Jun 04 09:37:42.701701 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-9597567e-8c22-4a2e-bab9-7fd5344fccaf req-8feb9646-7be4-46b9-bfd7-f0e99cc019f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062077 Jun 04 09:37:42.702781 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 472/937] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:37:43.328441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:43.329335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:43.337515 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:43.338180 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:43.339057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:43.339845 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:43.412493 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:43.413575 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:43.422107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:43.423310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:43.424393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:43.424969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:43.685751 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:43.697279 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-23540dd8-80ad-4dd2-8938-f0d685608670 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.372971 Jun 04 09:37:43.698093 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 466/938] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:43 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:43.733676 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:43.744007 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-31353fc6-4cd4-47d3-b905-462b051711c4 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.337294 Jun 04 09:37:43.748004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 473/939] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:43 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:44.716052 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:44.716833 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:44.723436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:44.723886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:44.724704 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:44.725213 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:44.744729 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:44.767342 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:44.768434 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:44.780650 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:44.781463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:44.782907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:44.783622 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:44.928160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:44.937655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-78618957-0cb9-4018-b0dc-df78f36bbb2d tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.225653 Jun 04 09:37:44.944878 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 467/940] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:44 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:44.979601 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:44.988598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-e80c0238-5cae-446f-80d5-576ca4166ff1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.228519 Jun 04 09:37:44.989202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 474/941] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:44 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:45.957582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:45.958720 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:45.967724 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:45.968174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:45.968990 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:45.969932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:46.010177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:46.011348 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:46.022099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:46.022982 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:46.024432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:46.025228 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:46.201754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:46.211954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4a31b234-1bb8-455b-8c63-040a5f23c534 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.260557 Jun 04 09:37:46.212863 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 468/942] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:45 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:46.242087 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:46.250574 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-25394486-879c-4e12-917d-692db0fb531c tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.247690 Jun 04 09:37:46.251296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 475/943] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:46 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:47.231300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:47.231954 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:47.234419 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:47.235711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=6 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:47.241417 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:47.244354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:47.244354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:47.244354 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:47.272568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:47.274183 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:47.283369 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:47.283903 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:47.284893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:47.285384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:47.474586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:47.483295 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7594e259-5f2b-41b6-8178-8a0d8a52b83c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.255767 Jun 04 09:37:47.484008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 469/944] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:47 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:47.511914 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:47.520406 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3748f110-37d9-48ff-a240-baab51c239e3 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.254384 Jun 04 09:37:47.521451 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 476/945] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:47 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:48.513467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:48.513467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:48.513467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:48.513467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:48.514898 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:48.514898 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:48.538823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:48.539905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:48.548099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:48.548582 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:48.549382 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:48.549840 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:48.608739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:48.750840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:48.761227 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:48.762447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-8eac2c55-615c-4336-bcdc-2fff0004ad74 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.264291 Jun 04 09:37:48.763822 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 470/946] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:48 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:48.771723 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f7faff20-fce6-4deb-af38-d28e0da7e0d5 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.237255 Jun 04 09:37:48.779056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 477/947] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:48 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:48.847202 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-9d50663b-f046-4cd1-a985-bd1ad8e6d677 req-04c33789-d8df-4f3a-8223-940c5b3630d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b60e3c6-dd02-4f36-94a2-905721262257", "name": "network-vif-plugged", "status": "completed", "tag": "ecbeca6b-ff36-477c-ab4c-040ddc298883"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:48.863812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9d50663b-f046-4cd1-a985-bd1ad8e6d677 req-04c33789-d8df-4f3a-8223-940c5b3630d6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:48.864494 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-9d50663b-f046-4cd1-a985-bd1ad8e6d677 req-04c33789-d8df-4f3a-8223-940c5b3630d6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:48.878710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-9d50663b-f046-4cd1-a985-bd1ad8e6d677 req-04c33789-d8df-4f3a-8223-940c5b3630d6 service nova] Creating event network-vif-plugged:ecbeca6b-ff36-477c-ab4c-040ddc298883 for instance 0b60e3c6-dd02-4f36-94a2-905721262257 on hv-cinder-84469 Jun 04 09:37:48.886409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-9d50663b-f046-4cd1-a985-bd1ad8e6d677 req-04c33789-d8df-4f3a-8223-940c5b3630d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120130 Jun 04 09:37:48.892356 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 471/948] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:37:49.781677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:49.782825 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:49.790371 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:49.795344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:49.795344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:49.795344 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:49.801676 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:49.802392 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:49.809873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:49.810644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:49.811586 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:49.812029 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:50.089715 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:50.096187 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:50.101412 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-0b1465eb-6120-4c48-bb5f-9366f7570dc4 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1318 microversion: 2.1 time: 0.324241 Jun 04 09:37:50.102047 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 478/949] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:49 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:50.106357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a4c303f6-7941-4ddc-a1b3-bee6e5b11338 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.311006 Jun 04 09:37:50.107104 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 472/950] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:49 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:51.124759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:51.125647 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:51.125836 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:51.126472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:51.128763 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:51.138231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.138231 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:51.138557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.138557 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:51.138775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.138775 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:51.138936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.138936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:51.345510 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:51.354100 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-2d2e97e2-63e7-467a-8bbb-5c9a7f86ff88 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1508 microversion: 2.1 time: 0.232158 Jun 04 09:37:51.354710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 473/951] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:51 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:51.363503 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:51.373917 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c64e6e0-6e28-4995-a298-31d374a23d00", "device": "/dev/sdb"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:37:51.375644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:51.377593 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-11525e9b-68c1-4cc4-b0bf-9d6b1309fd01 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.256871 Jun 04 09:37:51.378577 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 479/952] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:51 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:51.382344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.382830 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:51.383635 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:51.384078 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:52.402290 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:52.402904 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:52.409757 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:52.415911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:52.415911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:52.415911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:52.453101 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6686d349-751a-427c-b5d0-573d69218a71 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "POST /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.082681 Jun 04 09:37:52.454157 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 474/953] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Jun 4 09:37:51 2022] POST /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257/os-volume_attachments => generated 194 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:37:52.572894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:52.584310 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d72dcc99-8049-4410-867d-72147c696c96 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.185992 Jun 04 09:37:52.584916 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 480/954] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:52 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:37:53.605098 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:53.606415 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:53.618084 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:53.618545 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:53.619373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:53.619818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:53.783431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:53.791906 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1b82d427-9497-49e0-8675-5527a8fcbd66 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.193648 Jun 04 09:37:53.792542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 475/955] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:53 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:54.818456 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:54.819103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:54.821814 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:37:54.827984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:54.828161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:54.829662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:54.837828 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:54.993993 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:55.009257 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-09fbb853-8558-4a5c-94c3-c313dc22561e tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.194764 Jun 04 09:37:55.010338 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 481/956] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:54 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:56.035751 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:56.036776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:56.045045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:56.045499 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:56.046296 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:56.046728 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:56.413776 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:56.422202 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-39a1387f-1a56-4bb4-9e82-90d5ddb39066 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.391107 Jun 04 09:37:56.423490 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 476/957] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:56 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:57.447986 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:57.448686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:57.456363 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:57.456821 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:57.457614 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:57.458054 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:57.638642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:57.651589 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b818471c-2893-40b6-876c-7f3469c0d530 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.207270 Jun 04 09:37:57.652746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 482/958] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:57 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:58.679525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:58.681896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:58.693847 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:58.694580 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:58.695881 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:58.696608 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:58.885235 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:37:58.894836 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5475cdba-5c46-46b6-99f1-849ec3b9b3d7 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.223238 Jun 04 09:37:58.895790 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 477/959] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:58 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:37:59.919783 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:37:59.920965 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:37:59.933025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:59.933760 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:37:59.934745 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:37:59.935247 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:00.113040 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:00.123126 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6bf24494-378e-49a9-a626-76f68102a228 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1570 microversion: 2.1 time: 0.210811 Jun 04 09:38:00.123725 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 483/960] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:37:59 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:00.148571 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:00.149181 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:00.156107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:00.157211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:00.158015 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:00.158461 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:00.510073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5d168b0f-f102-47f8-bfcb-694656056e0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "POST /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5/action" status: 202 len: 0 microversion: 2.1 time: 0.365234 Jun 04 09:38:00.511600 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 478/961] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:38:00 2022] POST /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:38:00.524462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:00.527520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:00.535833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:00.536634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:00.538064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:00.538838 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:00.721062 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:00.733934 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6949daf1-c428-4881-9f47-9e583fc2adef tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1578 microversion: 2.1 time: 0.216215 Jun 04 09:38:00.735443 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 484/962] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:00 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1578 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:01.763978 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:01.765200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:01.776741 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:01.783947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:01.783947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:01.783947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:01.970653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:01.979159 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-96981a0f-b4b3-4c78-97f1-45236d7f8107 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1518 microversion: 2.1 time: 0.221841 Jun 04 09:38:01.979840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 479/963] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:01 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:02.998274 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:02.998806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:03.007517 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:03.007967 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:03.008817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:03.009305 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:03.159353 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:03.167601 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f230f232-8dac-4d50-b371-c0834da44356 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1520 microversion: 2.1 time: 0.173260 Jun 04 09:38:03.168199 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 485/964] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:02 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:03.931071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-c0a9a381-0801-4f90-98e7-39f2ead3c970 req-05c582b2-815c-458f-b3e9-e9342adbdb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "name": "network-vif-unplugged", "status": "completed", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:03.946516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c0a9a381-0801-4f90-98e7-39f2ead3c970 req-05c582b2-815c-458f-b3e9-e9342adbdb31 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:03.947307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-c0a9a381-0801-4f90-98e7-39f2ead3c970 req-05c582b2-815c-458f-b3e9-e9342adbdb31 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:03.972689 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.compute.server_external_events [req-c0a9a381-0801-4f90-98e7-39f2ead3c970 req-05c582b2-815c-458f-b3e9-e9342adbdb31 service nova] Unable to find a host for instance 3929ccb4-c14c-4301-bac7-cae49a726de5. Dropping event network-vif-unplugged {{(pid=118476) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 09:38:03.974351 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-c0a9a381-0801-4f90-98e7-39f2ead3c970 req-05c582b2-815c-458f-b3e9-e9342adbdb31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049683 Jun 04 09:38:03.975460 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 480/965] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 09:38:04.194511 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:04.195281 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:04.202194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:04.212847 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:04.212847 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:04.212847 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:04.352035 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:04.360569 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ab8d61ab-49c8-45f0-9014-2a6ae664e5eb tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1520 microversion: 2.1 time: 0.170142 Jun 04 09:38:04.361195 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 486/966] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:04 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:05.378886 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:05.379636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:05.387005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:05.387471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:05.388342 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:05.388962 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:05.560585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:05.570452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-256a9235-697e-4c28-a62e-41ad16ed7a73 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1520 microversion: 2.1 time: 0.195691 Jun 04 09:38:05.572718 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 481/967] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:05 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:38:06.597300 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:06.598235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:06.605462 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:06.605911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:06.606722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:06.607161 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:06.764790 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:06.773942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c3fe777e-0ae0-451c-a2ef-56d6ba17ee8a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.181885 Jun 04 09:38:06.774677 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 487/968] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:06 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:07.793814 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:07.796717 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:07.803436 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:07.803893 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:07.804749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:07.805211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:07.975728 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:07.984107 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e8d43e97-7bbb-4a5d-a109-13504c17d816 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.194490 Jun 04 09:38:07.984757 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 482/969] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:07 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:09.002157 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:09.002784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:09.010602 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:09.011088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:09.011882 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:09.012352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:09.162573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:09.177655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-7fcc83b8-89e6-479f-b208-371e21d51ab2 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.179062 Jun 04 09:38:09.178732 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 488/970] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:08 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:10.204224 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:10.205246 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:10.213118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:10.213644 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:10.214853 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:10.215428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:10.220806 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:38:10.373400 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:10.387064 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-18ab121a-353f-4c98-bb41-63d4a7708231 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.186941 Jun 04 09:38:10.388182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 483/971] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:10 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:11.408106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:11.409115 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:11.421085 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:11.422734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:11.423897 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:11.424516 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:11.431784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=100 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:38:11.585164 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:11.595396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c5b51b76-c9bd-4064-9367-8f83babe9a87 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.192346 Jun 04 09:38:11.595396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 489/972] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:11 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:12.613368 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:12.613960 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:12.621158 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:12.621612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:12.622410 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:12.622854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:12.776335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:12.785360 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b7266ec7-9c5a-4ed2-8bd0-4246f3089ee6 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.176802 Jun 04 09:38:12.785959 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 484/973] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:12 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:13.805077 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:13.806186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:13.815666 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:13.816166 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:13.817154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:13.817678 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:13.975202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:13.983423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-da2456a0-1207-40b5-b4c9-2d3786cf7457 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.183272 Jun 04 09:38:13.984018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 490/974] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:13 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:14.078126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:14.079290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:14.086673 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:14.087138 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:14.087975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:14.088485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:14.183199 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lazy-loading 'services' on Instance uuid 0b60e3c6-dd02-4f36-94a2-905721262257 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:38:14.510373 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7aee82c6-94a8-4ad9-a230-afab61758732 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257/os-volume_attachments/5c64e6e0-6e28-4995-a298-31d374a23d00" status: 202 len: 0 microversion: 2.1 time: 0.436137 Jun 04 09:38:14.511004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 485/975] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:38:14 2022] DELETE /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257/os-volume_attachments/5c64e6e0-6e28-4995-a298-31d374a23d00 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:38:15.002655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:15.003296 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:15.010661 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:15.011114 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:15.011922 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:15.012404 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:15.173779 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:15.188417 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-28fdf0ef-4e34-42ca-a6ef-b6bce7567fea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.189956 Jun 04 09:38:15.190899 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 491/976] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:14 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:16.216110 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:16.217227 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:16.224382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.224842 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:16.225648 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.226088 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:16.395692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:16.406357 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-62f28179-8df6-4625-8271-e493ac9392ea tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.194197 Jun 04 09:38:16.407200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 486/977] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:16 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:16.710104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:16.710906 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:16.723259 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.724076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:16.725662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.726510 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:16.785936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:38:16.984016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-921571042"}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:16.988484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:16.994371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.994994 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:16.996086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:16.996728 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:17.161617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ea1780fd-20d2-4bc9-aadb-8f08f9990276 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 204 len: 0 microversion: 2.1 time: 0.459337 Jun 04 09:38:17.162697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 492/978] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:38:16 2022] DELETE /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:38:17.178027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:17.179423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:17.191882 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.network.security_group_api [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Removing security group b75cbef9-bf9a-4a9b-a751-a08ff25e4be6 from port 57fc7a38-0352-4ed2-86c0-8326320ec471 Jun 04 09:38:17.192204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:17.192204 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:17.195962 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:17.197525 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:17.485037 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:17.500639 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f8a0b873-5d7c-40e7-8dfb-6216538b3d1b tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1514 microversion: 2.1 time: 0.330018 Jun 04 09:38:17.502100 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 493/979] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:17 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:17.512850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:17.514182 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:17.526417 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:17.527117 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:17.528839 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:17.529560 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:18.205286 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:18.214091 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db9538ec-d415-44ad-90f0-9d10be672e0a tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.710035 Jun 04 09:38:18.214694 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 494/980] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:17 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:18.503267 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fd276dc3-f8f7-47f2-b4df-8212b4262c3e tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action" status: 202 len: 0 microversion: 2.1 time: 1.523797 Jun 04 09:38:18.509836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-5a3a3050-6391-4678-9051-ccd7c1aef6b2 req-a8e0fb3d-d335-4325-9535-da8c975380a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:18.514057 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 487/981] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Jun 4 09:38:16 2022] POST /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/action => generated 0 bytes in 1536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:38:18.523942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-5a3a3050-6391-4678-9051-ccd7c1aef6b2 req-a8e0fb3d-d335-4325-9535-da8c975380a3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:18.524414 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-5a3a3050-6391-4678-9051-ccd7c1aef6b2 req-a8e0fb3d-d335-4325-9535-da8c975380a3 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:18.538756 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:18.539941 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:18.543216 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-5a3a3050-6391-4678-9051-ccd7c1aef6b2 req-a8e0fb3d-d335-4325-9535-da8c975380a3 service nova] Creating event network-changed:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:38:18.551608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-5a3a3050-6391-4678-9051-ccd7c1aef6b2 req-a8e0fb3d-d335-4325-9535-da8c975380a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045705 Jun 04 09:38:18.557488 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 495/982] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:38:18.563848 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:18.565149 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:18.566887 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:18.567671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:18.867856 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:18.883309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-75056b5c-a2f7-47e5-add5-882b54d0ad83 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1514 microversion: 2.1 time: 0.359223 Jun 04 09:38:18.895307 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 488/983] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:18 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1514 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:19.182741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-d16fa8b0-dedc-4f2b-a456-8ac18e0e05a2 req-8c14219a-8655-4c68-a7bb-5da995ad0eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "name": "network-vif-plugged", "status": "completed", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:19.198958 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d16fa8b0-dedc-4f2b-a456-8ac18e0e05a2 req-8c14219a-8655-4c68-a7bb-5da995ad0eed service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:19.199739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d16fa8b0-dedc-4f2b-a456-8ac18e0e05a2 req-8c14219a-8655-4c68-a7bb-5da995ad0eed service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:19.223107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-d16fa8b0-dedc-4f2b-a456-8ac18e0e05a2 req-8c14219a-8655-4c68-a7bb-5da995ad0eed service nova] Creating event network-vif-plugged:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:38:19.233051 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-d16fa8b0-dedc-4f2b-a456-8ac18e0e05a2 req-8c14219a-8655-4c68-a7bb-5da995ad0eed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058642 Jun 04 09:38:19.234629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 496/984] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:38:19.242648 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:19.243841 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:19.253393 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:19.254068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:19.255237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:19.255900 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:19.903032 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:19.911900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:19.913071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:19.919374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-46d8b7f6-c14e-41d3-8b24-20874f13b17f tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.687001 Jun 04 09:38:19.921383 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 489/985] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:19 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:19.922907 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:19.923712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:19.925188 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:19.926086 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:20.343103 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:20.351613 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-21af8b82-94d8-46cf-bc63-13fa2a0f865c tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1514 microversion: 2.1 time: 0.446326 Jun 04 09:38:20.352215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 497/986] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:19 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1514 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:38:20.758824 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-d0e26c15-5063-4ec4-9273-297e67bb3a3a req-7cfa07f2-4e83-42a6-a73e-efd5aca20182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b60e3c6-dd02-4f36-94a2-905721262257", "name": "network-vif-deleted", "tag": "ecbeca6b-ff36-477c-ab4c-040ddc298883"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:20.772671 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d0e26c15-5063-4ec4-9273-297e67bb3a3a req-7cfa07f2-4e83-42a6-a73e-efd5aca20182 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:20.774860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d0e26c15-5063-4ec4-9273-297e67bb3a3a req-7cfa07f2-4e83-42a6-a73e-efd5aca20182 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:20.786746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-d0e26c15-5063-4ec4-9273-297e67bb3a3a req-7cfa07f2-4e83-42a6-a73e-efd5aca20182 service nova] Creating event network-vif-deleted:ecbeca6b-ff36-477c-ab4c-040ddc298883 for instance 0b60e3c6-dd02-4f36-94a2-905721262257 on hv-cinder-84469 Jun 04 09:38:20.792869 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-d0e26c15-5063-4ec4-9273-297e67bb3a3a req-7cfa07f2-4e83-42a6-a73e-efd5aca20182 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040511 Jun 04 09:38:20.794138 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 490/987] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:38:20.958766 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:20.959797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:20.967309 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:20.967759 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:20.968588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:20.969644 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.236519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:21.237577 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:21.251258 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.252582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.253686 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:21.255067 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.256145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.273651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-69437636-dbc6-419a-8f2e-64415545b1a1 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1576 microversion: 2.1 time: 0.320467 Jun 04 09:38:21.274957 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 498/988] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:20 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1576 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:21.371429 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:21.372727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:21.382177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.382926 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.384031 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.385030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.387731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lazy-loading 'services' on Instance uuid 0d891f1c-404c-458b-8672-60cd5ccdacfe {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:38:21.443431 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.444374 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.445494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lazy-loading 'fault' on Instance uuid 0b60e3c6-dd02-4f36-94a2-905721262257 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:38:21.527160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:21.541845 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-28c69167-5ac2-4426-95f4-140d42aad7f1 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1308 microversion: 2.1 time: 0.175815 Jun 04 09:38:21.543154 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 499/989] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:21 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:21.722995 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-54e4b808-002e-4bc2-b4d0-c251251982f3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments/3214b5e3-3600-412e-b7a9-aac97302d98e" status: 202 len: 0 microversion: 2.1 time: 0.494661 Jun 04 09:38:21.724018 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 491/990] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:38:21 2022] DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments/3214b5e3-3600-412e-b7a9-aac97302d98e => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:38:21.738523 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:21.739977 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:21.750688 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.751811 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.753119 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:21.754423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:21.812746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-10197b6b-7a41-4967-b125-5c4485945d38 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080538 Jun 04 09:38:21.814177 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 500/991] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:38:21 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:38:22.295353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:22.296188 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:22.299533 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=40 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:38:22.306045 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.306610 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.307484 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.307935 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.564143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:22.565024 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:22.574132 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:22.579105 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.579561 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.582366 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.582912 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.619302 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-6bdf44da-0fc5-46c0-9c50-c8992685ad09 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1563 microversion: 2.1 time: 0.329698 Jun 04 09:38:22.619992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 492/992] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:22 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1563 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:22.662309 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.663147 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.664005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lazy-loading 'fault' on Instance uuid 0b60e3c6-dd02-4f36-94a2-905721262257 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:38:22.778181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '611fcce3edba4ce68c50d96736c7b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77242525fe2f49c6b38755c270885b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:22.792142 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4a7514fd-25cb-477c-8031-3602964eddcf tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 200 len: 1308 microversion: 2.1 time: 0.232154 Jun 04 09:38:22.794272 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 501/993] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:22 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:38:22.830280 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-28059663-ad24-42b1-ab3a-e8d3deb8d488 req-e2849e21-395d-41f3-9ca5-1bd57f30c07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:22.845909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:22.848236 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:22.853758 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-28059663-ad24-42b1-ab3a-e8d3deb8d488 req-e2849e21-395d-41f3-9ca5-1bd57f30c07f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.864858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-28059663-ad24-42b1-ab3a-e8d3deb8d488 req-e2849e21-395d-41f3-9ca5-1bd57f30c07f service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.874495 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.876243 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.878987 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:22.880089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:22.892438 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-28059663-ad24-42b1-ab3a-e8d3deb8d488 req-e2849e21-395d-41f3-9ca5-1bd57f30c07f service nova] Creating event network-changed:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:38:22.905372 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-28059663-ad24-42b1-ab3a-e8d3deb8d488 req-e2849e21-395d-41f3-9ca5-1bd57f30c07f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081822 Jun 04 09:38:22.906982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 493/994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:38:22.963008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-292ae5d4-2836-4ea3-a707-23bfd5351d82 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137625 Jun 04 09:38:22.963612 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 502/995] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:38:22 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:38:23.817491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:23.818683 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] [instance: 0b60e3c6-dd02-4f36-94a2-905721262257] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:23.826516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:23.826966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:23.827782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:23.828787 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:23.844601 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] HTTP exception thrown: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Request method failure captured: Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 HTTP/1.1 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyeFeR_n5JB7HOezDWrcQQtJOpjJHzYPSRgF_AuBv0fqmz0jJcKo9U241AwQ61VHfr5gazVgDfGfvBLu6shq3B_tSbR7S6G9Ls2PI63a7LSRCHIlIi64ZEEGb-Pdukzds6Oq2US-oUUZFHO7Vgf6BWmsHYmW37Tb7yKsIyzqY1RIOkM Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 77242525fe2f49c6b38755c270885b79 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:38:23.846215 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77242525fe2f49c6b38755c270885b79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/77242525fe2f49c6b38755c270885b79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_77242525fe2f49c6b38755c270885b79", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/77242525fe2f49c6b38755c270885b79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 77242525fe2f49c6b38755c270885b79 Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112966208 Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-VolumesSnapshotTestJSON-2112966208-project Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 611fcce3edba4ce68c50d96736c7b853 Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112966208-project Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. Jun 04 09:38:23.849190 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '0b60e3c6-dd02-4f36-94a2-905721262257'} Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:38:23.851054 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. Jun 04 09:38:23.854092 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:23.856989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] Returning 404 to user: Instance 0b60e3c6-dd02-4f36-94a2-905721262257 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:38:23.856989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-77091714-084a-42ad-8777-5b7913150e86 tempest-VolumesSnapshotTestJSON-2112966208 tempest-VolumesSnapshotTestJSON-2112966208-project] 10.222.0.46 "GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257" status: 404 len: 111 microversion: 2.1 time: 0.035620 Jun 04 09:38:23.856989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 494/996] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:23 2022] GET /compute/v2.1/servers/0b60e3c6-dd02-4f36-94a2-905721262257 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:38:23.981450 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:23.983063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:23.995279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:23.996089 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:23.997628 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:23.998432 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:24.039865 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dd3b46ce-864b-4d8d-85c4-f0a6d39b6ac4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066710 Jun 04 09:38:24.040486 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 503/997] 10.222.0.46 () {58 vars in 1301 bytes} [Sat Jun 4 09:38:23 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 09:38:24.051174 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:24.051850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:24.059496 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:24.060086 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:24.065299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:24.065299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:24.150692 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] HTTP exception thrown: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe is not attached to volume 3214b5e3-3600-412e-b7a9-aac97302d98e Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Request method failure captured: Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments/3214b5e3-3600-412e-b7a9-aac97302d98e HTTP/1.1 Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimydsn4g1JzZysVD5RXxK5kw0byRTx4Dz3Faoj4yjpp6p8qubI87eS5oeDNBp5D-_1LI3OtY5EAKEUpA-ZhP7OJtTdaWwmxKhmKs5gxwtSklgyW4Du3AHzaC4yGp0IZ3hwOqNN3dIthVoIgVDOOGfgrH0rcrERmf3D2mJkQ7ceBLuKWg Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: a3e40664a37c420c9fc2e05af20e182b Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:38:24.155633 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a3e40664a37c420c9fc2e05af20e182b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: a3e40664a37c420c9fc2e05af20e182b Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestMinimumBasicScenario-1025234440-project Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 0d44567701db44e3802d73705c899dd4 Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestMinimumBasicScenario-1025234440-project Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:38:24.157471 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe is not attached to volume 3214b5e3-3600-412e-b7a9-aac97302d98e Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'server_id': '0d891f1c-404c-458b-8672-60cd5ccdacfe', 'id': '3214b5e3-3600-412e-b7a9-aac97302d98e'} Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3214b5e3-3600-412e-b7a9-aac97302d98e. Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:38:24.158358 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe is not attached to volume 3214b5e3-3600-412e-b7a9-aac97302d98e Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe is not attached to volume 3214b5e3-3600-412e-b7a9-aac97302d98e Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:24.160191 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Returning 404 to user: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe is not attached to volume 3214b5e3-3600-412e-b7a9-aac97302d98e {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:38:24.161259 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-4e76f44b-a2e8-4f95-b863-d7c189ec1fc7 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments/3214b5e3-3600-412e-b7a9-aac97302d98e" status: 404 len: 154 microversion: 2.1 time: 0.111402 Jun 04 09:38:24.161259 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 495/998] 10.222.0.46 () {58 vars in 1415 bytes} [Sat Jun 4 09:38:24 2022] DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe/os-volume_attachments/3214b5e3-3600-412e-b7a9-aac97302d98e => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:38:25.548836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:25.549712 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:25.552440 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:38:25.559209 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:25.559946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:25.561005 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:25.561485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:25.592143 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:38:25.596081 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:38:26.122235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2b2e7927-1c73-45ac-bb31-bfc5dc21845a tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 204 len: 0 microversion: 2.1 time: 0.577862 Jun 04 09:38:26.122746 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 504/999] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:38:25 2022] DELETE /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:38:26.131300 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:26.132993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:26.142867 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:26.142992 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:26.143882 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:26.144264 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:26.332922 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:26.342028 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-06d051e9-06e7-4ef9-b15f-ccb5dae849cb tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1555 microversion: 2.1 time: 0.214509 Jun 04 09:38:26.342759 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 496/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:26 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:38:26.588560 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:38:26.589533 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:38:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:38:27.361349 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:27.362063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:27.369140 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:27.369603 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:27.370381 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:27.370816 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:27.526727 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:27.535106 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-b2f0a8d3-41e1-473a-9985-b666c541b3c3 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1555 microversion: 2.1 time: 0.178046 Jun 04 09:38:27.535711 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 505/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:27 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:28.553205 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:28.553874 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:28.561074 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:28.561536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:28.562860 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:28.563390 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:28.740602 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:28.748621 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-181b46a8-1d31-4f0e-98c3-dd15cf5685b4 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1555 microversion: 2.1 time: 0.199559 Jun 04 09:38:28.749213 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 497/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:28 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:29.771054 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:29.772498 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:29.785152 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:29.785954 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:29.788743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:29.788743 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:30.040823 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:30.049397 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f89dbb25-0f58-4ecb-b925-3368989776c5 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1555 microversion: 2.1 time: 0.286190 Jun 04 09:38:30.056902 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 506/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:29 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1555 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:30.259229 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-1eef37ef-8a92-45e7-9db4-4efb34ae3b2f req-a773802d-8c26-4747-bb68-b2e3852eda02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d891f1c-404c-458b-8672-60cd5ccdacfe", "name": "network-vif-deleted", "tag": "57fc7a38-0352-4ed2-86c0-8326320ec471"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:38:30.272325 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1eef37ef-8a92-45e7-9db4-4efb34ae3b2f req-a773802d-8c26-4747-bb68-b2e3852eda02 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:30.273012 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1eef37ef-8a92-45e7-9db4-4efb34ae3b2f req-a773802d-8c26-4747-bb68-b2e3852eda02 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:30.293783 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-1eef37ef-8a92-45e7-9db4-4efb34ae3b2f req-a773802d-8c26-4747-bb68-b2e3852eda02 service nova] Creating event network-vif-deleted:57fc7a38-0352-4ed2-86c0-8326320ec471 for instance 0d891f1c-404c-458b-8672-60cd5ccdacfe on hv-cinder-84469 Jun 04 09:38:30.305481 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-1eef37ef-8a92-45e7-9db4-4efb34ae3b2f req-a773802d-8c26-4747-bb68-b2e3852eda02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053127 Jun 04 09:38:30.306364 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 498/1004] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:38:31.099874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:31.102972 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:31.117888 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:31.118702 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:31.119970 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:31.120580 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:31.172083 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:31.172943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:31.173870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lazy-loading 'fault' on Instance uuid 0d891f1c-404c-458b-8672-60cd5ccdacfe {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:38:31.227690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d44567701db44e3802d73705c899dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e40664a37c420c9fc2e05af20e182b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:38:31.240097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9f51d49a-e5b6-4dae-a547-a4cbb14c0bd6 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 200 len: 1348 microversion: 2.1 time: 0.169040 Jun 04 09:38:31.240797 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 507/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:31 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 1348 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:38:32.277517 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:32.278737 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] [instance: 0d891f1c-404c-458b-8672-60cd5ccdacfe] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:38:32.290620 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:32.291131 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:32.292080 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:38:32.292694 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:38:32.310196 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] HTTP exception thrown: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Request method failure captured: Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe HTTP/1.1 Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimydsn4g1JzZysVD5RXxK5kw0byRTx4Dz3Faoj4yjpp6p8qubI87eS5oeDNBp5D-_1LI3OtY5EAKEUpA-ZhP7OJtTdaWwmxKhmKs5gxwtSklgyW4Du3AHzaC4yGp0IZ3hwOqNN3dIthVoIgVDOOGfgrH0rcrERmf3D2mJkQ7ceBLuKWg Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: a3e40664a37c420c9fc2e05af20e182b Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:38:32.311873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a3e40664a37c420c9fc2e05af20e182b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a3e40664a37c420c9fc2e05af20e182b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: a3e40664a37c420c9fc2e05af20e182b Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1025234440 Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestMinimumBasicScenario-1025234440-project Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: 0d44567701db44e3802d73705c899dd4 Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestMinimumBasicScenario-1025234440-project Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. Jun 04 09:38:32.315223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '0d891f1c-404c-458b-8672-60cd5ccdacfe'} Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:38:32.317151 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. Jun 04 09:38:32.320333 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:38:32.323593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Returning 404 to user: Instance 0d891f1c-404c-458b-8672-60cd5ccdacfe could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:38:32.323593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-36812829-c08f-49a5-b3c9-c42b0a8a5f85 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe" status: 404 len: 111 microversion: 2.1 time: 0.044240 Jun 04 09:38:32.323593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 499/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:38:32 2022] GET /compute/v2.1/servers/0d891f1c-404c-458b-8672-60cd5ccdacfe => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:38:32.328256 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fa6a92c9-e17b-48bd-9b20-055c62e00728 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] Calling method '.version_select at 0x7fa41571c310>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:38:32.478185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fa6a92c9-e17b-48bd-9b20-055c62e00728 tempest-TestMinimumBasicScenario-1025234440 tempest-TestMinimumBasicScenario-1025234440-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897396718" status: 202 len: 0 microversion: 2.1 time: 0.157503 Jun 04 09:38:32.478926 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 508/1007] 10.222.0.46 () {58 vars in 1268 bytes} [Sat Jun 4 09:38:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897396718 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:39:02.144451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=15 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:02.144451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:02.368145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-44f26ced-47b7-4c10-87ef-472d79ff9921 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Action: 'create', calling method: .version_select at 0x7fa415beee50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1925059598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1NMzTVZCWikHW6PVE7WXUUuAAmVF2Mc8Eql2mjNzZvxMzIu8zIJAHCAt+FQoVk4gOP6I96dQ7bdNFLvdjhj3YT/4gbBIDJR3netpxCiWsIm7MN0M2HI8JaQLK1ioEKIg=="}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:02.392703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-44f26ced-47b7-4c10-87ef-472d79ff9921 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for project 3c5c8695d627407f91f991dc91808a4b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:39:02.399698 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-44f26ced-47b7-4c10-87ef-472d79ff9921 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for user c59c71bc492841b3b22c8e6d66599768 and project 3c5c8695d627407f91f991dc91808a4b. Resources: {'key_pairs'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:39:02.497812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-44f26ced-47b7-4c10-87ef-472d79ff9921 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.359177 Jun 04 09:39:02.498536 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 500/1008] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Jun 4 09:39:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:39:21.447738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-750016715", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925059598", "security_groups": [{"name": "tempest-secgroup-smoke-2066289987"}], "block_device_mapping_v2": [{"uuid": "10a0ba37-c5c4-4153-b3f3-2ea5b5802320", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5052fbea-5778-4be7-87c0-ef258535d1af"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:21.459080 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:21.459767 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:21.586875 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] validate_networks() for [('5052fbea-5778-4be7-87c0-ef258535d1af', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:39:22.011504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:39:22.012034 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:39:22.012794 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:39:22.013311 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:39:22.013820 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:39:22.024932 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:22.025373 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:22.026171 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:22.026598 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:22.044908 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:39:22.049094 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for user c59c71bc492841b3b22c8e6d66599768 and project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:39:22.111889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:39:22.114060 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10a0ba37-c5c4-4153-b3f3-2ea5b5802320',volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:39:22.569446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-dc7a8aeb-4c82-46fb-b1f4-1f69bc4f7f68 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.127241 Jun 04 09:39:22.570222 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 509/1009] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:39:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:39:22.583312 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=4 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:22.584501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:22.592254 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0ae31696-bc4b-40ed-868a-aac89adf7584 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:22.592951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0ae31696-bc4b-40ed-868a-aac89adf7584 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:22.674405 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0ae31696-bc4b-40ed-868a-aac89adf7584 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:22.682819 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0ae31696-bc4b-40ed-868a-aac89adf7584 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1094 microversion: 2.1 time: 0.102218 Jun 04 09:39:22.683427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 501/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:22 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:23.708235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:23.708899 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:23.716844 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:23.717308 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:23.718792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:23.719244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:23.822967 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:23.832380 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4516b084-20c9-4fdb-a5cf-66bb0d361b50 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1144 microversion: 2.1 time: 0.127970 Jun 04 09:39:23.832935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 510/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:23 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1144 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:24.860353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:24.861014 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:24.868231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:24.868710 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:24.869538 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:24.870091 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:24.937071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:24.949879 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-da7ae2a9-15e6-473f-8b88-3a89ea652f3e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1192 microversion: 2.1 time: 0.094373 Jun 04 09:39:24.954933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 502/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:24 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:25.969755 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:25.970279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:25.990526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:25.990526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:25.990526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:25.990526 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:26.263969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:26.278173 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-470e342d-efa7-4c17-90d6-6b3544542d8c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1278 microversion: 2.1 time: 0.313098 Jun 04 09:39:26.280577 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 511/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:25 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:39:27.299808 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-49705b55-e357-41ef-8463-6ffe1bd5151e req-5badfc44-fd32-4556-a640-0e9508b99d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc43470-4d90-4405-aa2e-1f856b852765", "tag": "c51c4208-a790-4026-9bc5-a63ccabf90d5"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:27.305870 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:27.306756 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:27.314116 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:27.314562 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:27.315578 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:27.320796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:27.329136 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-49705b55-e357-41ef-8463-6ffe1bd5151e req-5badfc44-fd32-4556-a640-0e9508b99d17 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:27.331288 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-49705b55-e357-41ef-8463-6ffe1bd5151e req-5badfc44-fd32-4556-a640-0e9508b99d17 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:27.354792 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-49705b55-e357-41ef-8463-6ffe1bd5151e req-5badfc44-fd32-4556-a640-0e9508b99d17 service nova] Creating event network-changed:c51c4208-a790-4026-9bc5-a63ccabf90d5 for instance 0fc43470-4d90-4405-aa2e-1f856b852765 on hv-cinder-84469 Jun 04 09:39:27.364543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-49705b55-e357-41ef-8463-6ffe1bd5151e req-5badfc44-fd32-4556-a640-0e9508b99d17 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066763 Jun 04 09:39:27.364543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 503/1014] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:39:27.598985 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:27.611705 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1ec64ec1-2430-46ff-8cff-76b2c95e881b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.309555 Jun 04 09:39:27.612670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 512/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:27 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:28.636243 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:28.637139 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:28.644146 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:28.644850 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:28.645702 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:28.646177 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:28.815127 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:28.823569 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-cb7db78f-7c3d-41ce-8a37-dfc19bd0d55f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.192053 Jun 04 09:39:28.824237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 504/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:28 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:29.843608 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:29.844361 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:29.851475 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:29.851926 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:29.852860 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:29.853289 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:29.996000 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:30.003710 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1b22838b-a51b-42f7-a8c0-85e5f28afbf3 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.165445 Jun 04 09:39:30.004270 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 513/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:29 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:31.024525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:31.025734 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:31.037377 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:31.038169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:31.039582 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:31.040427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:31.219717 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:31.227863 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3aab23d3-921b-493f-8a6d-92f1e09c2aa9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.210646 Jun 04 09:39:31.228472 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 505/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:31 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:32.244893 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:32.245490 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:32.247869 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:32.248648 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:32.254836 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:32.255393 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:32.256053 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:32.256530 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:32.411718 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:32.419772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c0aec98a-4dc0-46ff-9b50-8b7452787806 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.178995 Jun 04 09:39:32.420446 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 514/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:32 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:33.440811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:33.448335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:33.448335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:39:33.450625 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:33.451160 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:33.452718 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:33.453223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:33.605319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:33.613482 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-552b31c4-7d98-4ceb-b4cc-81236be799fd tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.176853 Jun 04 09:39:33.614070 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 506/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:33 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:34.631167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:34.631784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:34.638579 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:34.639029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:34.639821 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:34.640262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:34.787540 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:34.801514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a6c7ef3e-1cf4-4979-adc5-3b83c2ef5b2b tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.174172 Jun 04 09:39:34.802584 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 515/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:34 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:35.827782 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:35.828515 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:35.835604 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:35.836063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:35.836938 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:35.837384 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:36.042384 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:36.053491 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-e4f545e1-8fae-42cb-b2b6-d3e9927fd461 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.230275 Jun 04 09:39:36.054083 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 507/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:35 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:39:37.079850 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:37.080729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:37.087573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.088278 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.090141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.090141 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.133878 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:37.134414 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:37.141725 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.142173 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.143166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.143598 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.172807 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:39:37.327215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:37.327215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-36201c4b-b27e-4752-8259-28faaaaec3ff tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.247236 Jun 04 09:39:37.327215 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 516/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:37 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:37.423945 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-579386e8-b8ef-420e-9e3c-c0d58b9419c8 req-d3fdc1a8-6cc7-4dee-b49c-cf645aab246e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:37.430716 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-579386e8-b8ef-420e-9e3c-c0d58b9419c8 req-d3fdc1a8-6cc7-4dee-b49c-cf645aab246e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.431162 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-579386e8-b8ef-420e-9e3c-c0d58b9419c8 req-d3fdc1a8-6cc7-4dee-b49c-cf645aab246e service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.443242 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-579386e8-b8ef-420e-9e3c-c0d58b9419c8 req-d3fdc1a8-6cc7-4dee-b49c-cf645aab246e service nova] Creating event network-changed:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:39:37.449821 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-579386e8-b8ef-420e-9e3c-c0d58b9419c8 req-d3fdc1a8-6cc7-4dee-b49c-cf645aab246e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124678 Jun 04 09:39:37.450894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 517/1024] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:39:37.705316 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-eed43f34-3566-4b1d-8786-71c4eeeead30 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 204 len: 0 microversion: 2.1 time: 0.575783 Jun 04 09:39:37.710747 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 508/1025] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:39:37 2022] DELETE /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:39:37.718563 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:37.722206 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:37.727325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.728149 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.729205 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.729651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.902543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-68052277-d080-4f64-9333-f6c90a4d1a1c req-60ac3f77-845a-4046-8718-1c8e21e5b374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc43470-4d90-4405-aa2e-1f856b852765", "name": "network-vif-plugged", "status": "completed", "tag": "c51c4208-a790-4026-9bc5-a63ccabf90d5"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:37.923165 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-68052277-d080-4f64-9333-f6c90a4d1a1c req-60ac3f77-845a-4046-8718-1c8e21e5b374 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:37.924125 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-68052277-d080-4f64-9333-f6c90a4d1a1c req-60ac3f77-845a-4046-8718-1c8e21e5b374 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:37.939335 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-68052277-d080-4f64-9333-f6c90a4d1a1c req-60ac3f77-845a-4046-8718-1c8e21e5b374 service nova] Creating event network-vif-plugged:c51c4208-a790-4026-9bc5-a63ccabf90d5 for instance 0fc43470-4d90-4405-aa2e-1f856b852765 on hv-cinder-84469 Jun 04 09:39:37.945397 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-68052277-d080-4f64-9333-f6c90a4d1a1c req-60ac3f77-845a-4046-8718-1c8e21e5b374 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053450 Jun 04 09:39:37.947467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 509/1026] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:39:37.962287 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:37.972960 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-3ff19629-1a0b-4f2e-a5bc-cce4f855c790 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.260685 Jun 04 09:39:37.976208 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 518/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:37 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:39:38.343597 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:38.344544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:38.352242 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:38.352739 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:38.353556 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:38.354004 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:38.553767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:38.563231 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-634599eb-5156-4ee7-93ea-2873bfbc6805 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.225326 Jun 04 09:39:38.563832 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 510/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:38 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:38.991970 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:38.992696 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:39.000246 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:39.000720 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:39.001504 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:39.001939 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:39.209063 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:39.218439 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-99986e37-0f0f-48ad-a688-e70c7e194b0b tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1569 microversion: 2.1 time: 0.229499 Jun 04 09:39:39.219056 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 519/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:38 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:39.580763 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:39.581428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:39.588346 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:39.588800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:39.589585 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:39.590018 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:39.733398 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:39.741527 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-9733a6f3-3b49-42f7-9240-79ee01557243 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1266 microversion: 2.1 time: 0.165247 Jun 04 09:39:39.742121 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 511/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:39 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:40.239564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:40.240698 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:40.249738 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:40.250185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:40.250976 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:40.251410 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:40.553894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:40.563008 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-1b20187f-dea0-4f6f-b6a3-9b5a5f741449 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1450 microversion: 2.1 time: 0.330593 Jun 04 09:39:40.563792 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 520/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:40 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1450 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:40.761584 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:40.765789 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:40.780175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-2163d7bb-3bdf-43a6-b18a-ced2d6a6bdd8 req-082a54c1-2f9e-47fd-b47c-ad46e32ae9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3929ccb4-c14c-4301-bac7-cae49a726de5", "name": "network-vif-deleted", "tag": "9864a826-5e4f-4326-b509-2e17ff9f1949"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:40.780818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:40.781827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:40.783118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:40.784326 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:40.807159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-2163d7bb-3bdf-43a6-b18a-ced2d6a6bdd8 req-082a54c1-2f9e-47fd-b47c-ad46e32ae9ab service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:40.807936 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-2163d7bb-3bdf-43a6-b18a-ced2d6a6bdd8 req-082a54c1-2f9e-47fd-b47c-ad46e32ae9ab service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:40.825176 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-2163d7bb-3bdf-43a6-b18a-ced2d6a6bdd8 req-082a54c1-2f9e-47fd-b47c-ad46e32ae9ab service nova] Creating event network-vif-deleted:9864a826-5e4f-4326-b509-2e17ff9f1949 for instance 3929ccb4-c14c-4301-bac7-cae49a726de5 on hv-cinder-84469 Jun 04 09:39:40.834118 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-2163d7bb-3bdf-43a6-b18a-ced2d6a6bdd8 req-082a54c1-2f9e-47fd-b47c-ad46e32ae9ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060888 Jun 04 09:39:40.834984 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 521/1032] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:39:40.971974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:40.984382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-63cb806b-252f-44c3-adf2-76028fd36150 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1452 microversion: 2.1 time: 0.225674 Jun 04 09:39:40.984382 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 512/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:40 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:41.003607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:41.004921 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:41.015734 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:41.016577 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:41.017975 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:41.018719 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:41.214532 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:41.224690 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-99f03969-af09-4095-adca-a0e0b7a57347 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1452 microversion: 2.1 time: 0.230265 Jun 04 09:39:41.225599 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 522/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:40 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1452 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:41.584948 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:41.586245 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:41.598441 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:41.601340 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:41.601340 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:41.601340 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:41.720084 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79755c3f9eec4c5ab3e98038015bff32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bc412a2d2f4fc68c2a9f3562232807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:39:41.733593 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fecc3d3e-9092-4307-b8ce-eeeb6bc051b0 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 200 len: 1219 microversion: 2.1 time: 0.155607 Jun 04 09:39:41.734667 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 513/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:41 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 1219 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:39:42.753808 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:42.754948 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] [instance: 3929ccb4-c14c-4301-bac7-cae49a726de5] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:39:42.765091 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:42.765812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:42.769822 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:42.772377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:42.797071 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] HTTP exception thrown: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Request method failure captured: Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 HTTP/1.1 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyctP6lZX6v7jYgVc2fZ29feIXU4SSZlb8NKXq7crfHxmtfp47cMtf_2uUjDVcmVhZlyjX3Hlf3V-ARglpcRqqGdRqVV8tABFYQ7KshjdVyNgQ25TXCD2DXxKNrxnWgs7NNuKu-2z9abjrV87qCaQWDQRHFqBIPkDVe9TALbCGE9nuc Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: d7bc412a2d2f4fc68c2a9f3562232807 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestShelveInstance-113003 Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:39:42.802073 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d7bc412a2d2f4fc68c2a9f3562232807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d7bc412a2d2f4fc68c2a9f3562232807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d7bc412a2d2f4fc68c2a9f3562232807", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d7bc412a2d2f4fc68c2a9f3562232807"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestShelveInstance-113003 Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: d7bc412a2d2f4fc68c2a9f3562232807 Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestShelveInstance-113003 Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestShelveInstance-113003-project Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: 79755c3f9eec4c5ab3e98038015bff32 Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestShelveInstance-113003-project Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '3929ccb4-c14c-4301-bac7-cae49a726de5'} Jun 04 09:39:42.808841 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:39:42.811333 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. Jun 04 09:39:42.814445 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:39:42.819235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Returning 404 to user: Instance 3929ccb4-c14c-4301-bac7-cae49a726de5 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:39:42.819235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-26b7bf92-308e-477a-bcda-4520f373d498 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5" status: 404 len: 111 microversion: 2.1 time: 0.055908 Jun 04 09:39:42.819235 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 523/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:39:42 2022] GET /compute/v2.1/servers/3929ccb4-c14c-4301-bac7-cae49a726de5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:39:43.171993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-dc2e3075-fba2-445a-be3d-b7d15e402062 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] Calling method '.version_select at 0x7fa415e2f940>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:39:43.298650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-dc2e3075-fba2-445a-be3d-b7d15e402062 tempest-TestShelveInstance-113003 tempest-TestShelveInstance-113003-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2065999011" status: 202 len: 0 microversion: 2.1 time: 0.133952 Jun 04 09:39:43.300170 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 514/1037] 10.222.0.46 () {58 vars in 1253 bytes} [Sat Jun 4 09:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2065999011 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 09:39:44.290167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-0d429e65-e170-4729-abf1-10dbcd73e961 req-19ef2161-c15f-4165-a5a0-874d0f1988e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fc43470-4d90-4405-aa2e-1f856b852765", "tag": "c51c4208-a790-4026-9bc5-a63ccabf90d5"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:39:44.300489 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0d429e65-e170-4729-abf1-10dbcd73e961 req-19ef2161-c15f-4165-a5a0-874d0f1988e0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:39:44.300935 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-0d429e65-e170-4729-abf1-10dbcd73e961 req-19ef2161-c15f-4165-a5a0-874d0f1988e0 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:39:44.316638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-0d429e65-e170-4729-abf1-10dbcd73e961 req-19ef2161-c15f-4165-a5a0-874d0f1988e0 service nova] Creating event network-changed:c51c4208-a790-4026-9bc5-a63ccabf90d5 for instance 0fc43470-4d90-4405-aa2e-1f856b852765 on hv-cinder-84469 Jun 04 09:39:44.323009 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-0d429e65-e170-4729-abf1-10dbcd73e961 req-19ef2161-c15f-4165-a5a0-874d0f1988e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038742 Jun 04 09:39:44.323781 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 524/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:41:15.514412 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:41:15.516051 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:41:35.816167 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:41:35.817067 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:41:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:41:39.085069 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:39.086046 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:39.091651 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:39.099034 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:39.099705 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:39.100166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:39.101008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:39.101459 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:39.131448 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:41:39.490185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-784d015a-772c-4a2c-ac34-ac95381a4ede tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 204 len: 0 microversion: 2.1 time: 0.407194 Jun 04 09:41:39.490974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 515/1039] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:41:39 2022] DELETE /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:41:39.498660 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:39.499771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=76 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:39.504564 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:39.507933 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:39.512657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:39.513249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:39.514179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:39.514714 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:39.987874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:39.996503 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-db444738-9c8e-4008-9cea-6e8f7f9acb6f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1577 microversion: 2.1 time: 0.500481 Jun 04 09:41:39.997181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 525/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:39 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1577 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:41.015334 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:41.016115 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:41.023234 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:41.023827 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:41.024789 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:41.025344 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:41.316625 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:41.325000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3bde60ff-baf2-49f9-ac24-8118c90a4775 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1577 microversion: 2.1 time: 0.314224 Jun 04 09:41:41.325653 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 516/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:41 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1577 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:42.347920 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:42.349074 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:42.360250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:42.361104 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:42.362093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:42.362833 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:42.524787 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:42.533025 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6100c72d-4010-4e16-8d4a-d75b47ad3a37 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1509 microversion: 2.1 time: 0.190850 Jun 04 09:41:42.533640 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 526/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:42 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:42.639982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-d24ebf56-c3f7-4693-bdab-c525c1aec3e2 req-4af0a3ef-2792-4be0-a25c-07af2339903c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fc43470-4d90-4405-aa2e-1f856b852765", "name": "network-vif-deleted", "tag": "c51c4208-a790-4026-9bc5-a63ccabf90d5"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:41:42.650578 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d24ebf56-c3f7-4693-bdab-c525c1aec3e2 req-4af0a3ef-2792-4be0-a25c-07af2339903c service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:42.651035 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-d24ebf56-c3f7-4693-bdab-c525c1aec3e2 req-4af0a3ef-2792-4be0-a25c-07af2339903c service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:42.663965 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-d24ebf56-c3f7-4693-bdab-c525c1aec3e2 req-4af0a3ef-2792-4be0-a25c-07af2339903c service nova] Creating event network-vif-deleted:c51c4208-a790-4026-9bc5-a63ccabf90d5 for instance 0fc43470-4d90-4405-aa2e-1f856b852765 on hv-cinder-84469 Jun 04 09:41:42.670711 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-d24ebf56-c3f7-4693-bdab-c525c1aec3e2 req-4af0a3ef-2792-4be0-a25c-07af2339903c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Jun 04 09:41:42.674184 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 517/1043] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:41:43.557520 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:43.558468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:43.569957 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:43.570496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:43.571552 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:43.572375 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:43.619388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:43.620136 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:43.621029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.objects.instance [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lazy-loading 'fault' on Instance uuid 0fc43470-4d90-4405-aa2e-1f856b852765 {{(pid=118477) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:41:43.677800 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:43.687162 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f0219570-31f7-4551-899a-69112f304726 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 200 len: 1230 microversion: 2.1 time: 0.134522 Jun 04 09:41:43.687754 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 527/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:43 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 1230 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:44.705525 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:44.706328 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:44.714290 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:44.714982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:44.716588 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:44.717082 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:44.732993 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] HTTP exception thrown: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Request method failure captured: Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 HTTP/1.1 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyguHaxOpbgoY03U2ngvjdZYrO5Qcx7rgFQIAZA6dg1aQ4nUxUXATR1SA-Uk1nMrZD1yU0pOre7UQ2wrqdoxsqkME4cyjSIV8YZeCq3RyD7QxQBmGvfiJqoa1zDxqrD35esSA1nqR4Qwpr2F0RtfFnQZhyKo4kUU7e7aMDG65QfkLu8 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:41:44.734703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3c5c8695d627407f91f991dc91808a4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestVolumeBootPattern-212705993 Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: c59c71bc492841b3b22c8e6d66599768 Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:41:44.737211 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '0fc43470-4d90-4405-aa2e-1f856b852765'} Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:41:44.738746 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:41:44.741163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:41:44.743237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Returning 404 to user: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:41:44.743237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-a2fa1bfb-ff8f-45e4-9194-99f2aebd6e5e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 404 len: 111 microversion: 2.1 time: 0.035014 Jun 04 09:41:44.743831 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 518/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:44 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:41:44.846949 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1189732794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925059598", "security_groups": [{"name": "tempest-secgroup-smoke-2066289987"}], "block_device_mapping_v2": [{"uuid": "10a0ba37-c5c4-4153-b3f3-2ea5b5802320", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5052fbea-5778-4be7-87c0-ef258535d1af"}]}} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:41:44.980197 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.network.neutron [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] validate_networks() for [('5052fbea-5778-4be7-87c0-ef258535d1af', None, None, None, None, None)] {{(pid=118477) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:41:45.483831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:41:45.484255 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image limits 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:41:45.484785 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:41:45.485226 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image pref 0:0:0 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:41:45.485643 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.virt.hardware [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118477) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:41:45.495607 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:45.496059 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:45.497514 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:45.497960 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:45.516709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:41:45.521654 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.quota [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for user c59c71bc492841b3b22c8e6d66599768 and project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118477) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:41:45.588146 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Going to run 1 instances... {{(pid=118477) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:41:45.592260 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10a0ba37-c5c4-4153-b3f3-2ea5b5802320',volume_size=None,volume_type=None)] {{(pid=118477) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:41:46.084022 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [629b837a-5719-46f9-aef1-44dbb7b337cf] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 09:41:47.093405 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [629b837a-5719-46f9-aef1-44dbb7b337cf] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 48990. Jun 04 09:41:47.099441 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-ada0efca-8273-485d-83a3-c5386a8e8d1e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.256000 Jun 04 09:41:47.101537 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 528/1046] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:41:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:41:47.113346 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7c4b80b9-0e4d-49a9-af9b-349c29422743 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:47.114379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7c4b80b9-0e4d-49a9-af9b-349c29422743 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:47.190767 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7c4b80b9-0e4d-49a9-af9b-349c29422743 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:47.199068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7c4b80b9-0e4d-49a9-af9b-349c29422743 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1095 microversion: 2.1 time: 0.090418 Jun 04 09:41:47.200546 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 519/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:47 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:48.217846 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:48.218729 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:48.225659 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:48.226268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:48.227271 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:48.227817 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:48.318481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:48.326573 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-033a1cf8-a6f5-4681-b894-60b5b05e0f9c tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1145 microversion: 2.1 time: 0.113616 Jun 04 09:41:48.327174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 529/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:48 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:49.349391 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:49.350636 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:49.363650 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:49.366508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:49.366508 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:49.366754 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:49.473968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:49.488612 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-ba8dbda8-3e79-4dec-bea0-5875d6476944 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1201 microversion: 2.1 time: 0.146116 Jun 04 09:41:49.489974 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 520/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:49 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1201 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:50.515245 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:50.516463 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:50.531585 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:50.532423 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:50.534213 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:50.534974 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:50.809806 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:50.819740 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-fac4c2b9-319e-44ac-b6f2-804110a0c7d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1279 microversion: 2.1 time: 0.312230 Jun 04 09:41:50.820591 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 530/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:50 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1279 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:51.758155 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-1e8a73ab-039b-4a5c-9c13-18e64ce17f27 req-42ff2288-0490-4ad6-99eb-7170deec3c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5b153c-2996-47dd-a74f-2d04575755d7", "tag": "5e3e0cde-05e3-40d0-b707-fa88eedc6064"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:41:51.789990 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1e8a73ab-039b-4a5c-9c13-18e64ce17f27 req-42ff2288-0490-4ad6-99eb-7170deec3c29 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:51.790511 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-1e8a73ab-039b-4a5c-9c13-18e64ce17f27 req-42ff2288-0490-4ad6-99eb-7170deec3c29 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:51.806784 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-1e8a73ab-039b-4a5c-9c13-18e64ce17f27 req-42ff2288-0490-4ad6-99eb-7170deec3c29 service nova] Creating event network-changed:5e3e0cde-05e3-40d0-b707-fa88eedc6064 for instance 7c5b153c-2996-47dd-a74f-2d04575755d7 on hv-cinder-84469 Jun 04 09:41:51.813309 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-1e8a73ab-039b-4a5c-9c13-18e64ce17f27 req-42ff2288-0490-4ad6-99eb-7170deec3c29 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062401 Jun 04 09:41:51.814103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 521/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:41:51.845194 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:51.846055 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:51.857866 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:51.859394 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:51.860695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:51.861257 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:52.132360 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:52.141029 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-03f78158-87b7-4b2e-9b3a-c7f3b3078206 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.304785 Jun 04 09:41:52.141629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 531/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:51 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:53.164278 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:53.165120 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:53.172144 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:53.172654 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:53.173467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:53.173897 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:53.344655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:53.352786 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b720d5db-ae83-4c28-8f76-b355a8769fd0 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.193116 Jun 04 09:41:53.353428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 522/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:53 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:54.371609 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:54.372332 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:54.379663 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:54.380399 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:54.381250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:54.381741 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:54.541026 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:54.550425 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-87c055d1-b380-452c-89b4-3894a282a17f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.183693 Jun 04 09:41:54.551027 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 532/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:54 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:54.744605 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:41:54.744928 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:41:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:41:55.568932 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:55.570002 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:55.577923 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:55.578614 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:55.579514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:55.580118 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:55.727917 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:55.737431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-35481343-33df-4553-8606-3708787d3050 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.172823 Jun 04 09:41:55.741968 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 523/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:55 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:56.756045 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:56.756764 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:56.759269 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=2 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:56.760127 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=6 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:56.766622 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:56.767088 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:56.767898 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:56.768372 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:56.923466 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:56.931955 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-42676c83-e544-43ec-a3c6-79685bcca0e8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.180002 Jun 04 09:41:56.932659 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 533/1056] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:56 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:41:57.949101 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:57.949804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:57.952894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:41:57.959017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:57.959560 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:57.960486 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:57.960966 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:58.134894 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:58.143319 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-fb0f1b1e-7b5a-47e0-ba93-2d985a0621d5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.198231 Jun 04 09:41:58.143911 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 524/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:57 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:41:59.161905 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:41:59.162528 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:41:59.170193 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:59.170638 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:59.171424 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:41:59.171857 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:41:59.324913 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:41:59.338858 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-606502a2-7e76-4ffa-8123-1b385c9fb86f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.180650 Jun 04 09:41:59.340376 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 534/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:41:59 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:42:00.357058 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:00.357703 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:00.364939 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:00.365537 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:00.366467 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:00.367009 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:00.561709 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:00.570388 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1e0f3139-cf61-4017-be3d-42f0db5c15ef tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.217718 Jun 04 09:42:00.571126 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 525/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:00 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:42:01.588643 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:01.589468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:01.597700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:01.598186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:01.602457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:01.602457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:01.755079 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:01.763731 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-30ad9864-6f62-46ab-b3f6-1afee7089a11 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.179629 Jun 04 09:42:01.764339 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 535/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:01 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:42:02.280095 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-b379ea81-ed69-48a8-bbdf-21c0619c936d req-00b1f642-d313-45e4-b5d1-c467ebf505b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5b153c-2996-47dd-a74f-2d04575755d7", "name": "network-vif-plugged", "status": "completed", "tag": "5e3e0cde-05e3-40d0-b707-fa88eedc6064"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:42:02.295268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b379ea81-ed69-48a8-bbdf-21c0619c936d req-00b1f642-d313-45e4-b5d1-c467ebf505b6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:02.295268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-b379ea81-ed69-48a8-bbdf-21c0619c936d req-00b1f642-d313-45e4-b5d1-c467ebf505b6 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:02.307117 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-b379ea81-ed69-48a8-bbdf-21c0619c936d req-00b1f642-d313-45e4-b5d1-c467ebf505b6 service nova] Creating event network-vif-plugged:5e3e0cde-05e3-40d0-b707-fa88eedc6064 for instance 7c5b153c-2996-47dd-a74f-2d04575755d7 on hv-cinder-84469 Jun 04 09:42:02.313638 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-b379ea81-ed69-48a8-bbdf-21c0619c936d req-00b1f642-d313-45e4-b5d1-c467ebf505b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038455 Jun 04 09:42:02.314268 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 526/1061] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:42:02.785495 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:02.786494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:02.794657 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:02.795132 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:02.795929 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:02.796411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:02.960474 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:02.969563 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-84bd9b19-21bb-48ab-9655-09dccffb1de9 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.189266 Jun 04 09:42:02.970150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 536/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:02 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:42:03.988418 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:03.989186 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:03.996409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:03.996870 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:03.997699 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:03.998133 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:04.183964 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:04.194942 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c1c3a9d6-ea3e-4f6b-91d0-46922a4b2ff6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1267 microversion: 2.1 time: 0.211142 Jun 04 09:42:04.195766 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 527/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:03 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:42:05.215480 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:05.216175 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:05.223250 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:05.223693 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:05.224522 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:05.224970 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:05.379076 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:05.387873 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-2e80bcbb-a568-4b88-91e5-09a29e165d2a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1452 microversion: 2.1 time: 0.177303 Jun 04 09:42:05.388494 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 537/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:05 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:42:05.405304 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:42:05.406017 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:42:05.413914 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:05.414433 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:05.415306 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:05.415800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:05.588435 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:42:05.597565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-277cb80e-2821-4476-80e9-544dbbaec52d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1452 microversion: 2.1 time: 0.196365 Jun 04 09:42:05.598172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 528/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:42:05 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1452 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:42:08.130911 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-d161edc9-4458-4bd5-a60a-8f37ead81eec req-9b065ea8-5ba1-44f7-97b6-1dda68a0657a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5b153c-2996-47dd-a74f-2d04575755d7", "tag": "5e3e0cde-05e3-40d0-b707-fa88eedc6064"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:42:08.145137 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d161edc9-4458-4bd5-a60a-8f37ead81eec req-9b065ea8-5ba1-44f7-97b6-1dda68a0657a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:42:08.145943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-d161edc9-4458-4bd5-a60a-8f37ead81eec req-9b065ea8-5ba1-44f7-97b6-1dda68a0657a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:42:08.172644 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-d161edc9-4458-4bd5-a60a-8f37ead81eec req-9b065ea8-5ba1-44f7-97b6-1dda68a0657a service nova] Creating event network-changed:5e3e0cde-05e3-40d0-b707-fa88eedc6064 for instance 7c5b153c-2996-47dd-a74f-2d04575755d7 on hv-cinder-84469 Jun 04 09:42:08.183784 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-d161edc9-4458-4bd5-a60a-8f37ead81eec req-9b065ea8-5ba1-44f7-97b6-1dda68a0657a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062076 Jun 04 09:42:08.184969 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 538/1066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:43:44.091365 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:44.092208 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:44.096371 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-793259980", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925059598", "security_groups": [{"name": "tempest-secgroup-smoke-2066289987"}], "block_device_mapping_v2": [{"uuid": "82d0b9ff-6299-4074-bd3d-ba1d27d88e8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5052fbea-5778-4be7-87c0-ef258535d1af"}]}} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:43:44.249452 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.network.neutron [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] validate_networks() for [('5052fbea-5778-4be7-87c0-ef258535d1af', None, None, None, None, None)] {{(pid=118476) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 09:43:44.724841 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 09:43:44.725534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image limits 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 09:43:44.726469 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Flavor pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 09:43:44.727272 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Image pref 0:0:0 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 09:43:44.728037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.virt.hardware [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 09:43:44.745007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:44.745800 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:44.747237 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:44.748007 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:44.783000 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 09:43:44.791374 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.quota [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Getting quotas for user c59c71bc492841b3b22c8e6d66599768 and project 3c5c8695d627407f91f991dc91808a4b. Resources: {'ram', 'cores', 'instances'} {{(pid=118476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 09:43:44.869168 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Going to run 1 instances... {{(pid=118476) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 09:43:44.871427 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82d0b9ff-6299-4074-bd3d-ba1d27d88e8b',volume_size=None,volume_type=None)] {{(pid=118476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 09:43:45.286861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d47d70b0-04e7-48e6-9d25-9db9136ffd1f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.197036 Jun 04 09:43:45.288365 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 529/1067] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Jun 4 09:43:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 09:43:45.301014 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:45.302139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=78 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:45.308107 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a8ef3633-0f5a-4091-88f8-9a4d48d50528 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:45.309211 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a8ef3633-0f5a-4091-88f8-9a4d48d50528 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:45.376317 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a8ef3633-0f5a-4091-88f8-9a4d48d50528 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:45.384253 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a8ef3633-0f5a-4091-88f8-9a4d48d50528 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1094 microversion: 2.1 time: 0.085867 Jun 04 09:43:45.385121 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 539/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:45 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:46.406003 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3e9ea38a-0c38-4a5e-9896-7f7d5e347aee tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:46.407337 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3e9ea38a-0c38-4a5e-9896-7f7d5e347aee tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:46.484933 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3e9ea38a-0c38-4a5e-9896-7f7d5e347aee tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:46.496903 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3e9ea38a-0c38-4a5e-9896-7f7d5e347aee tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1094 microversion: 2.1 time: 0.098155 Jun 04 09:43:46.497896 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 530/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:46 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:47.524279 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-d5ad698c-a2ca-4497-bf20-6e8e7f388f96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:47.524967 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-d5ad698c-a2ca-4497-bf20-6e8e7f388f96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:47.587078 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-d5ad698c-a2ca-4497-bf20-6e8e7f388f96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:47.597826 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-d5ad698c-a2ca-4497-bf20-6e8e7f388f96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1094 microversion: 2.1 time: 0.078592 Jun 04 09:43:47.598541 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 540/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:47 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:43:48.617430 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-216b62a9-d9d6-492a-b861-a9e5d2cda4af tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:48.618081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-216b62a9-d9d6-492a-b861-a9e5d2cda4af tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:48.674749 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-216b62a9-d9d6-492a-b861-a9e5d2cda4af tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:48.682094 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-216b62a9-d9d6-492a-b861-a9e5d2cda4af tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1094 microversion: 2.1 time: 0.068776 Jun 04 09:43:48.682699 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 531/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:48 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:49.699352 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:49.700006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:49.707481 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:49.708011 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:49.709058 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:49.709496 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:49.797796 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:49.809187 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-a6601562-3ccf-4f88-b4a3-cb3901750fa1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1144 microversion: 2.1 time: 0.113483 Jun 04 09:43:49.810006 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 541/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:49 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1144 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:43:50.842603 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:50.843661 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:50.853200 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:50.853874 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:50.854854 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:50.855402 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:50.927655 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:50.940691 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-c05fe15a-b190-4a0e-aeab-a27515cccf09 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1136 microversion: 2.1 time: 0.104975 Jun 04 09:43:50.943026 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 532/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:50 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1136 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:51.962365 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:51.963628 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:51.971999 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:51.972267 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:51.973198 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:51.973667 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:52.057093 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:52.065842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-22f13c5f-dcbe-4c03-ab35-b6cb72e91ae1 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1210 microversion: 2.1 time: 0.108186 Jun 04 09:43:52.067064 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 542/1074] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:51 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:53.093182 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:53.094273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:53.105682 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:53.106428 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:53.107907 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:53.108605 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:53.370590 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:53.388379 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-7619fd79-390e-4c43-9350-2073f9769f01 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1278 microversion: 2.1 time: 0.300584 Jun 04 09:43:53.389416 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 533/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:53 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1278 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:54.022418 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-a9fae34d-943c-40d3-8c0b-5c62f0ff4ce7 req-0eb9acbe-2149-4653-bcf9-f72e1916be99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb0a9385-6004-4b2f-aa18-e4375ea2cbb2", "tag": "006563ee-6261-4ee4-914b-4843fc0eafdb"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:43:54.032702 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a9fae34d-943c-40d3-8c0b-5c62f0ff4ce7 req-0eb9acbe-2149-4653-bcf9-f72e1916be99 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:54.036513 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-a9fae34d-943c-40d3-8c0b-5c62f0ff4ce7 req-0eb9acbe-2149-4653-bcf9-f72e1916be99 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:54.053670 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-a9fae34d-943c-40d3-8c0b-5c62f0ff4ce7 req-0eb9acbe-2149-4653-bcf9-f72e1916be99 service nova] Creating event network-changed:006563ee-6261-4ee4-914b-4843fc0eafdb for instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 on hv-cinder-84469 Jun 04 09:43:54.059722 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-a9fae34d-943c-40d3-8c0b-5c62f0ff4ce7 req-0eb9acbe-2149-4653-bcf9-f72e1916be99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135811 Jun 04 09:43:54.060422 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 543/1076] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:43:54.418672 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:54.419887 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:54.432840 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:54.434005 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:54.435189 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:54.435873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:54.644534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:54.653256 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-bb6066b4-4647-4829-a7be-12f87abd4e31 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.242152 Jun 04 09:43:54.653983 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 534/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:54 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:55.680391 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:55.681028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:55.687925 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:55.688396 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:55.689186 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:55.689620 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:55.842307 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:55.850551 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f5b80b9e-7038-42b5-b456-cf5aeb86aa55 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.175175 Jun 04 09:43:55.851139 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 544/1078] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:55 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:43:56.877294 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:56.877967 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:56.879858 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=2 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:56.885816 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:56.886271 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:56.887063 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:56.887501 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:57.028040 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:57.035892 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d9dc1a90-4207-4e94-a811-63271b9e7840 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.162542 Jun 04 09:43:57.036521 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 535/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:56 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:58.053900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:58.055201 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:58.058004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell0:SELECT=4 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:58.063447 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:58.063940 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:58.064819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:58.065302 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:58.218160 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:58.226150 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9059abb2-8bf0-4605-926e-7f923b27d50a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.176196 Jun 04 09:43:58.227420 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 545/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:58 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:43:59.244343 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:43:59.245284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:43:59.247595 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell0:SELECT=10 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:43:59.253216 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:59.253674 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:59.254530 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:43:59.254971 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:43:59.435963 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:43:59.445936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-f5147b93-7867-4002-b88f-c0afcc27d6d6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.206092 Jun 04 09:43:59.446685 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 536/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:43:59 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:00.464642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:00.465262 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:00.472355 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:00.472815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:00.473621 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:00.474061 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:00.664521 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:00.672947 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-cfc84896-af5e-4d70-9355-bc56e22df681 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.212986 Jun 04 09:44:00.673642 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 546/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:00 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:44:01.756779 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:01.758332 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:01.765881 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:01.766347 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:01.767145 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:01.767591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:01.922599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:01.930447 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-3655fd48-43a7-4e1d-94c5-1af9de13deac tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.243141 Jun 04 09:44:01.931043 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 537/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:01 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:02.949700 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:02.950867 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:02.964028 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:02.964889 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:02.966390 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:02.967174 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:03.150202 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:03.163410 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-62a8a92c-281c-48d7-b8aa-10fc9b09bef4 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.219232 Jun 04 09:44:03.164492 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 547/1084] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:02 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:04.182542 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:04.183284 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:04.190652 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:04.191873 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:04.192027 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:04.192432 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:04.358500 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:04.366919 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-1ecd6bfe-7116-42f6-923e-44f02549a918 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.189345 Jun 04 09:44:04.367519 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 538/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:04 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:44:05.078013 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-701b6515-7f22-48b8-bf52-2a4d455c75c8 req-94c336ff-a5c5-4cd0-85cc-ce90daa594dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0a9385-6004-4b2f-aa18-e4375ea2cbb2", "name": "network-vif-plugged", "status": "completed", "tag": "006563ee-6261-4ee4-914b-4843fc0eafdb"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:44:05.090610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-701b6515-7f22-48b8-bf52-2a4d455c75c8 req-94c336ff-a5c5-4cd0-85cc-ce90daa594dd service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:05.090610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-701b6515-7f22-48b8-bf52-2a4d455c75c8 req-94c336ff-a5c5-4cd0-85cc-ce90daa594dd service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:05.109626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-701b6515-7f22-48b8-bf52-2a4d455c75c8 req-94c336ff-a5c5-4cd0-85cc-ce90daa594dd service nova] Creating event network-vif-plugged:006563ee-6261-4ee4-914b-4843fc0eafdb for instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 on hv-cinder-84469 Jun 04 09:44:05.118548 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-701b6515-7f22-48b8-bf52-2a4d455c75c8 req-94c336ff-a5c5-4cd0-85cc-ce90daa594dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108483 Jun 04 09:44:05.119768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 548/1086] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:44:05.385299 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:05.385975 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:05.393574 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:05.394185 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:05.395088 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:05.395685 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:05.609023 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:05.618323 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-0b87f735-23fd-4fdf-be10-3b949fd82eed tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.237437 Jun 04 09:44:05.619201 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 539/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:05 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:44:06.636768 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:06.637553 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:06.644485 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:06.645130 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:06.645943 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:06.646384 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:06.812909 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:06.822414 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-f4365e01-18b3-41dc-bfb1-1b224e7ce3d2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1266 microversion: 2.1 time: 0.190759 Jun 04 09:44:06.823045 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 549/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:06 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:07.840068 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:07.840774 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:07.848081 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:07.850687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:07.850687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:07.850687 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:08.009353 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:08.023962 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-144262e2-0df4-4e2d-8df6-9b51b80c3b96 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1451 microversion: 2.1 time: 0.187419 Jun 04 09:44:08.024998 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 540/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:07 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:08.041617 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:44:08.042244 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:44:08.049321 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:08.049772 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:08.050566 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:08.051004 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:08.208753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:44:08.218277 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-4edde71f-9c6d-4f4f-9625-e8e83936c94f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1451 microversion: 2.1 time: 0.180804 Jun 04 09:44:08.218901 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 550/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:44:08 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:44:10.999176 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ef018277-19ab-46ea-8648-faf7d1625a12 req-cebd03c8-1f57-436e-8a4b-df0ebfd332be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb0a9385-6004-4b2f-aa18-e4375ea2cbb2", "tag": "006563ee-6261-4ee4-914b-4843fc0eafdb"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:44:11.014273 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ef018277-19ab-46ea-8648-faf7d1625a12 req-cebd03c8-1f57-436e-8a4b-df0ebfd332be service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:44:11.015055 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ef018277-19ab-46ea-8648-faf7d1625a12 req-cebd03c8-1f57-436e-8a4b-df0ebfd332be service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:44:11.035534 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ef018277-19ab-46ea-8648-faf7d1625a12 req-cebd03c8-1f57-436e-8a4b-df0ebfd332be service nova] Creating event network-changed:006563ee-6261-4ee4-914b-4843fc0eafdb for instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 on hv-cinder-84469 Jun 04 09:44:11.045552 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ef018277-19ab-46ea-8648-faf7d1625a12 req-cebd03c8-1f57-436e-8a4b-df0ebfd332be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053275 Jun 04 09:44:11.046697 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 541/1091] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:44:50.468341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:44:50.469102 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:44:55.826606 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:44:55.827293 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:45:32.648417 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_api:SELECT=28 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:45:32.649739 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG dbcounter [-] [118477] Writing DB stats nova_cell1:SELECT=52 {{(pid=118477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:45:32.650082 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:45:32.651169 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG dbcounter [-] [118476] Writing DB stats nova_cell1:SELECT=58 {{(pid=118476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 09:45:32.656690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-6bb843d7-5080-48b5-8b6c-9c61b3d96b06 req-b3467894-6590-4d0f-8651-4bd992a3fcff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb0a9385-6004-4b2f-aa18-e4375ea2cbb2", "tag": "006563ee-6261-4ee4-914b-4843fc0eafdb"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:45:32.662629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:32.662629 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:32.668947 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6bb843d7-5080-48b5-8b6c-9c61b3d96b06 req-b3467894-6590-4d0f-8651-4bd992a3fcff service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:32.669407 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:32.669690 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-6bb843d7-5080-48b5-8b6c-9c61b3d96b06 req-b3467894-6590-4d0f-8651-4bd992a3fcff service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:32.670611 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:32.672016 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:32.672805 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:32.686729 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-6bb843d7-5080-48b5-8b6c-9c61b3d96b06 req-b3467894-6590-4d0f-8651-4bd992a3fcff service nova] Creating event network-changed:006563ee-6261-4ee4-914b-4843fc0eafdb for instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 on hv-cinder-84469 Jun 04 09:45:32.693678 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-6bb843d7-5080-48b5-8b6c-9c61b3d96b06 req-b3467894-6590-4d0f-8651-4bd992a3fcff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045733 Jun 04 09:45:32.697311 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 542/1092] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:45:32.725304 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Going to try to terminate instance {{(pid=118477) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:45:33.060941 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9e852f32-36cf-4e53-9e06-0be3d4ef0429 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 204 len: 0 microversion: 2.1 time: 0.415414 Jun 04 09:45:33.061819 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 551/1093] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:45:32 2022] DELETE /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 09:45:33.080065 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:33.082325 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:33.096872 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:33.097716 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:33.099844 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:33.100642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:33.316763 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:33.326163 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-b9832c66-1c0f-45a5-b33f-2fa95b6b111a tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1576 microversion: 2.1 time: 0.256605 Jun 04 09:45:33.327125 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 543/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:33 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:34.349510 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:34.350345 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:34.358325 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:34.358874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:34.360165 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:34.360887 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:34.546026 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:34.560560 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-6898c4a7-7317-4c41-a749-9af517792477 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1576 microversion: 2.1 time: 0.215795 Jun 04 09:45:34.561655 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 552/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:34 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:35.379485 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [req-ea7deee2-a287-432b-8119-4ea45033c5e3 req-daa9c1b6-0c3d-4f8a-bdc5-3fce609566cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb0a9385-6004-4b2f-aa18-e4375ea2cbb2", "name": "network-vif-deleted", "tag": "006563ee-6261-4ee4-914b-4843fc0eafdb"}]} {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:45:35.390920 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ea7deee2-a287-432b-8119-4ea45033c5e3 req-daa9c1b6-0c3d-4f8a-bdc5-3fce609566cb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:35.391535 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [req-ea7deee2-a287-432b-8119-4ea45033c5e3 req-daa9c1b6-0c3d-4f8a-bdc5-3fce609566cb service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:35.406642 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.compute.server_external_events [req-ea7deee2-a287-432b-8119-4ea45033c5e3 req-daa9c1b6-0c3d-4f8a-bdc5-3fce609566cb service nova] Creating event network-vif-deleted:006563ee-6261-4ee4-914b-4843fc0eafdb for instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 on hv-cinder-84469 Jun 04 09:45:35.412219 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [req-ea7deee2-a287-432b-8119-4ea45033c5e3 req-daa9c1b6-0c3d-4f8a-bdc5-3fce609566cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Jun 04 09:45:35.412874 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 544/1096] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 09:45:35.584831 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:35.586815 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:35.596610 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:35.597291 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:35.598318 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:35.599471 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:35.685946 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:35.697232 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-c8d29847-bec0-4bab-aa1c-ede8f3dc1d0f tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1225 microversion: 2.1 time: 0.120222 Jun 04 09:45:35.698272 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 553/1097] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:35 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:36.720195 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:36.721565 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:36.731220 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:36.732071 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:36.733596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:36.734385 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:36.774275 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:36.774731 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:36.775198 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.objects.instance [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lazy-loading 'fault' on Instance uuid cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 {{(pid=118476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 09:45:36.824431 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:36.838172 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-d906d836-75d2-4e41-b85f-779fcc8bcb19 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 200 len: 1184 microversion: 2.1 time: 0.123563 Jun 04 09:45:36.839250 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 545/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:36 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 1184 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:37.874771 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:37.875894 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: cb0a9385-6004-4b2f-aa18-e4375ea2cbb2] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:37.887874 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:37.888699 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:37.890113 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:37.890881 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:37.917697 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] HTTP exception thrown: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Request method failure captured: Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 HTTP/1.1 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyguHaxOpbgoY03U2ngvjdZYrO5Qcx7rgFQIAZA6dg1aQ4nUxUXATR1SA-Uk1nMrZD1yU0pOre7UQ2wrqdoxsqkME4cyjSIV8YZeCq3RyD7QxQBmGvfiJqoa1zDxqrD35esSA1nqR4Qwpr2F0RtfFnQZhyKo4kUU7e7aMDG65QfkLu8 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:45:37.921030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3c5c8695d627407f91f991dc91808a4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: c59c71bc492841b3b22c8e6d66599768 Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. Jun 04 09:45:37.922672 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': 'cb0a9385-6004-4b2f-aa18-e4375ea2cbb2'} Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:45:37.923662 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. Jun 04 09:45:37.925181 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:37.927347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Returning 404 to user: Instance cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:45:37.927347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-49ec5e81-df7e-4d6d-bc2f-3d60035b1ec5 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2" status: 404 len: 111 microversion: 2.1 time: 0.056167 Jun 04 09:45:37.927347 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 554/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:37 2022] GET /compute/v2.1/servers/cb0a9385-6004-4b2f-aa18-e4375ea2cbb2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:45:41.809396 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:41.810286 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:41.810626 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-46123b81-6900-4a57-ad70-6cd723c5c470 req-ce5c56f6-642f-4068-b45a-17965a94442a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5b153c-2996-47dd-a74f-2d04575755d7", "tag": "5e3e0cde-05e3-40d0-b707-fa88eedc6064"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:45:41.820514 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:41.821065 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-46123b81-6900-4a57-ad70-6cd723c5c470 req-ce5c56f6-642f-4068-b45a-17965a94442a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:41.821269 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:41.821549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-46123b81-6900-4a57-ad70-6cd723c5c470 req-ce5c56f6-642f-4068-b45a-17965a94442a service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:41.822341 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:41.823223 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:41.838249 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-46123b81-6900-4a57-ad70-6cd723c5c470 req-ce5c56f6-642f-4068-b45a-17965a94442a service nova] Creating event network-changed:5e3e0cde-05e3-40d0-b707-fa88eedc6064 for instance 7c5b153c-2996-47dd-a74f-2d04575755d7 on hv-cinder-84469 Jun 04 09:45:41.844818 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-46123b81-6900-4a57-ad70-6cd723c5c470 req-ce5c56f6-642f-4068-b45a-17965a94442a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037806 Jun 04 09:45:41.848753 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 555/1100] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:45:41.876861 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Going to try to terminate instance {{(pid=118476) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 09:45:42.372103 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-df317140-ac0c-41b5-92c8-4e9794a55bc2 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 204 len: 0 microversion: 2.1 time: 0.563900 Jun 04 09:45:42.372660 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 546/1101] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:45:41 2022] DELETE /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 09:45:42.383962 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:42.385377 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:42.397988 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:42.398822 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:42.400388 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:42.401411 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:42.674159 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.policy [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118477) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:42.684082 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-89e5ddfb-ab1a-4483-8514-9703aa574931 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1577 microversion: 2.1 time: 0.308780 Jun 04 09:45:42.684983 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 556/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:42 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1577 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:43.704008 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:43.704811 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:43.713669 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:43.714166 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:43.715016 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:43.715544 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:43.868982 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:43.877821 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-72117901-957e-4777-beba-f4443ac04590 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1458 microversion: 2.1 time: 0.178025 Jun 04 09:45:43.878414 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 547/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:43 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1458 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 09:45:44.553179 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [req-dd897959-0617-4860-92ca-5784bd9ee80f req-ec906a75-5911-4661-b424-620658956c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5b153c-2996-47dd-a74f-2d04575755d7", "name": "network-vif-deleted", "tag": "5e3e0cde-05e3-40d0-b707-fa88eedc6064"}]} {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 09:45:44.562842 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-dd897959-0617-4860-92ca-5784bd9ee80f req-ec906a75-5911-4661-b424-620658956c89 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:44.569038 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [req-dd897959-0617-4860-92ca-5784bd9ee80f req-ec906a75-5911-4661-b424-620658956c89 service nova] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:44.575612 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.compute.server_external_events [req-dd897959-0617-4860-92ca-5784bd9ee80f req-ec906a75-5911-4661-b424-620658956c89 service nova] Creating event network-vif-deleted:5e3e0cde-05e3-40d0-b707-fa88eedc6064 for instance 7c5b153c-2996-47dd-a74f-2d04575755d7 on hv-cinder-84469 Jun 04 09:45:44.581812 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [req-dd897959-0617-4860-92ca-5784bd9ee80f req-ec906a75-5911-4661-b424-620658956c89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 Jun 04 09:45:44.582468 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 557/1104] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Jun 4 09:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 09:45:44.897818 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:44.898812 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:44.907270 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:44.907716 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:44.908543 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:44.908989 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:45.004893 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.policy [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c71bc492841b3b22c8e6d66599768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c5c8695d627407f91f991dc91808a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118476) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 09:45:45.020143 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5f5035a7-7b30-41b8-aa73-4794814b4401 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 200 len: 1226 microversion: 2.1 time: 0.127126 Jun 04 09:45:45.021798 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 548/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:44 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 09:45:46.044506 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:46.045185 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 7c5b153c-2996-47dd-a74f-2d04575755d7] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:46.052350 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.052780 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.053586 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.054030 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.069634 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] HTTP exception thrown: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Request method failure captured: Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 HTTP/1.1 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyguHaxOpbgoY03U2ngvjdZYrO5Qcx7rgFQIAZA6dg1aQ4nUxUXATR1SA-Uk1nMrZD1yU0pOre7UQ2wrqdoxsqkME4cyjSIV8YZeCq3RyD7QxQBmGvfiJqoa1zDxqrD35esSA1nqR4Qwpr2F0RtfFnQZhyKo4kUU7e7aMDG65QfkLu8 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:45:46.071315 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3c5c8695d627407f91f991dc91808a4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: c59c71bc492841b3b22c8e6d66599768 Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. Jun 04 09:45:46.074239 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '7c5b153c-2996-47dd-a74f-2d04575755d7'} Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:45:46.075695 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. Jun 04 09:45:46.079709 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.083268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Returning 404 to user: Instance 7c5b153c-2996-47dd-a74f-2d04575755d7 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:45:46.083268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-9a4bbde9-1d3f-45f7-8d0d-dc3acbe42c7e tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7" status: 404 len: 111 microversion: 2.1 time: 0.033953 Jun 04 09:45:46.083268 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 558/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:46 2022] GET /compute/v2.1/servers/7c5b153c-2996-47dd-a74f-2d04575755d7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:45:46.762804 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:46.772599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.compute.api [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118476) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:46.772599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.772599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.772599 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.773451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG oslo_concurrency.lockutils [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.787596 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.wsgi [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] HTTP exception thrown: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Request method failure captured: Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: request: DELETE /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 HTTP/1.1 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept: application/json Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Accept-Encoding: identity Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Connection: close Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Length: 0 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Content-Type: application/json Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Host: 10.222.0.46 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Openstack-System-Scope: None Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: User-Agent: python-urllib3/1.26.9 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Auth-Token: gAAAAABimyguHaxOpbgoY03U2ngvjdZYrO5Qcx7rgFQIAZA6dg1aQ4nUxUXATR1SA-Uk1nMrZD1yU0pOre7UQ2wrqdoxsqkME4cyjSIV8YZeCq3RyD7QxQBmGvfiJqoa1zDxqrD35esSA1nqR4Qwpr2F0RtfFnQZhyKo4kUU7e7aMDG65QfkLu8 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Id: None Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Domain-Name: None Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Identity-Status: Confirmed Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Is-Admin-Project: True Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Id: default Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Domain-Name: Default Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Project-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Role: member,reader Jun 04 09:45:46.789451 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Roles: member,reader Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3c5c8695d627407f91f991dc91808a4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-Tenant-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Id: default Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Domain-Name: Default Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Id: c59c71bc492841b3b22c8e6d66599768 Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: X-User-Name: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: method: > Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: exception: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.791247 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: action_args: {'id': '0fc43470-4d90-4405-aa2e-1f856b852765'} Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:45:46.802114 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.805020 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.807516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Returning 404 to user: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. {{(pid=118476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:45:46.807516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-64e1f8bc-7d71-458e-b07d-a5d9fbf773c8 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 404 len: 111 microversion: 2.1 time: 0.032271 Jun 04 09:45:46.807516 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 549/1107] 10.222.0.46 () {58 vars in 1238 bytes} [Sat Jun 4 09:45:46 2022] DELETE /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 09:45:46.807923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '>' {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:46.807923 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.compute.api [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] [instance: 0fc43470-4d90-4405-aa2e-1f856b852765] Fetching instance by UUID {{(pid=118477) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 09:45:46.809651 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.810097 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.811018 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 09:45:46.811450 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG oslo_concurrency.lockutils [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Lock "074277cd-5d2b-4eb5-8cdc-e149db967384" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 09:45:46.827335 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.wsgi [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] HTTP exception thrown: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Request method failure captured: Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: request: GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 HTTP/1.1 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept: application/json Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Accept-Encoding: identity Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Connection: close Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Length: 0 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Content-Type: application/json Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Host: 10.222.0.46 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Openstack-System-Scope: None Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: User-Agent: python-urllib3/1.26.9 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Auth-Token: gAAAAABimyguHaxOpbgoY03U2ngvjdZYrO5Qcx7rgFQIAZA6dg1aQ4nUxUXATR1SA-Uk1nMrZD1yU0pOre7UQ2wrqdoxsqkME4cyjSIV8YZeCq3RyD7QxQBmGvfiJqoa1zDxqrD35esSA1nqR4Qwpr2F0RtfFnQZhyKo4kUU7e7aMDG65QfkLu8 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Id: None Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Domain-Name: None Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Identity-Status: Confirmed Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Is-Admin-Project: True Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Id: default Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Domain-Name: Default Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Project-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Role: member,reader Jun 04 09:45:46.835549 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Roles: member,reader Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3c5c8695d627407f91f991dc91808a4b", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3c5c8695d627407f91f991dc91808a4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}] Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Id: 3c5c8695d627407f91f991dc91808a4b Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-Tenant-Name: tempest-TestVolumeBootPattern-212705993 Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Id: default Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Domain-Name: Default Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Id: c59c71bc492841b3b22c8e6d66599768 Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: X-User-Name: tempest-TestVolumeBootPattern-212705993-project Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: method: > Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: exception: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.838588 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: action_args: {'id': '0fc43470-4d90-4405-aa2e-1f856b852765'} Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: {{(pid=118477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 09:45:46.840596 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. Jun 04 09:45:46.842942 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: ERROR nova.api.openstack.wsgi Jun 04 09:45:46.845570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: DEBUG nova.api.openstack.wsgi [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Returning 404 to user: Instance 0fc43470-4d90-4405-aa2e-1f856b852765 could not be found. {{(pid=118477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 09:45:46.845570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO nova.api.openstack.requestlog [None req-17f78973-b11a-43bf-889d-441bf6346ae6 tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765" status: 404 len: 111 microversion: 2.1 time: 0.033530 Jun 04 09:45:46.845570 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: [pid: 118477|app: 0|req: 559/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Sat Jun 4 09:45:46 2022] GET /compute/v2.1/servers/0fc43470-4d90-4405-aa2e-1f856b852765 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 09:45:48.476506 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: DEBUG nova.api.openstack.wsgi [None req-5837a1d4-9203-441b-9d85-e41a2e476e6d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] Calling method '.version_select at 0x7fa415b59d30>' {{(pid=118476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 09:45:48.570073 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO nova.api.openstack.requestlog [None req-5837a1d4-9203-441b-9d85-e41a2e476e6d tempest-TestVolumeBootPattern-212705993 tempest-TestVolumeBootPattern-212705993-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1925059598" status: 202 len: 0 microversion: 2.1 time: 0.097765 Jun 04 09:45:48.570662 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: [pid: 118476|app: 0|req: 550/1109] 10.222.0.46 () {58 vars in 1262 bytes} [Sat Jun 4 09:45:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1925059598 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 09:46:15.526037 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:46:15.526936 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:46:47.105900 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:46:47.106568 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:48:10.478911 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:48:10.479591 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:48:15.836323 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:48:15.837178 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:48:22.560951 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:48:22.561684 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:48:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:48:34.758349 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:48:34.758978 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:49:35.535409 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:49:35.536031 dv-cinder-844695-1-iscsi devstack@n-api.service[118476]: Sat Jun 4 09:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 09:50:07.116457 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 09:50:07.117099 dv-cinder-844695-1-iscsi devstack@n-api.service[118477]: Sat Jun 4 09:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!